03/20/2025 00:45:49.177 7f806f54eb88 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/20/2025 00:45:49.177 7f806f54eb88 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/20/2025 00:45:49.177 7f806f54eb88 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/20/2025 00:45:49.178 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.42:2181,10.0.0.12:2181,10.0.0.47:2181 03/20/2025 00:45:49.178 7f806f54eb88 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 00:45:49.179 7f80662dc048 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 03/20/2025 00:45:49.179 7f80662dc048 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 03/20/2025 00:45:49.179 7f80662de978 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 03/20/2025 00:45:49.180 7f80662de978 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 00:45:49.180 7f80662de978 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/20/2025 00:45:49.180 7f80662de978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:49.180 7f80662de978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 03/20/2025 00:45:49.180 7f80662de978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:49.180 7f80662de978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:49.180 7f80662de978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 00:45:49.180 7f80662de978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:49.180 7f80662de978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:49.181 7f80662de978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431549180079 collector_name = collector_ip = collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 03/20/2025 00:45:49.181 7f80662de978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:49.189 7f80663042e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:49.189 7f80663042e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 00:45:49.189 7f80663042e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:53.182 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:45:53.183 7f80662a8ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:45:53.184 7f80662a8ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:45:53.184 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:45:53.184 7f80662a8ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:45:53.184 7f80662a8ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:45:53.185 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:45:53.185 7f80662a8ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:45:53.185 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:53.186 7f80662a8ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:45:53.186 7f80662a8ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:53.186 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:53.187 7f80662a8ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431549180079 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:45:53.187 7f80662a8ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:57.186 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:45:57.187 7f80662a8ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:45:57.187 7f80662a8ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:45:57.187 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:45:57.187 7f80662a8ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:45:57.187 7f80662a8ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:45:57.187 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:45:57.188 7f80662a8ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:45:57.188 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:57.188 7f80662a8ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:45:57.188 7f80662a8ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:57.188 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:57.188 7f80662a8ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431549180079 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:45:57.188 7f80662a8ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:01.190 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:01.191 7f80662a8ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:01.191 7f80662a8ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:01.191 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:01.191 7f80662a8ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:01.191 7f80662a8ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:01.191 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:01.191 7f80662a8ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:01.191 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:01.192 7f80662a8ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:01.192 7f80662a8ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:01.192 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:01.192 7f80662a8ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431549180079 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:46:01.192 7f80662a8ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:05.194 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:05.195 7f80662a8ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:05.195 7f80662a8ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:05.195 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:05.196 7f80662a8ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:05.196 7f80662a8ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:05.196 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:05.196 7f80662a8ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:05.196 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:05.196 7f80662a8ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:05.196 7f80662a8ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:05.196 7f80662a8ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:05.196 7f80662a8ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431549180079 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:46:05.196 7f80662a8ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:08.793 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.42:9041', '10.0.0.12:9041', '10.0.0.47:9041'] 03/20/2025 00:46:08.794 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 03/20/2025 00:46:08.794 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 00:46:08.794 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 00:46:08.794 7f80662a8390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:08.795 7f80662a8390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/20/2025 00:46:08.795 7f80662a8390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:08.802 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 00:46:08.882 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 00:46:08.884 7f80662c3198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:08.884 7f80662c3198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/20/2025 00:46:08.884 7f80662c3198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:08.905 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 00:46:08.905 7f80662c9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:08.905 7f80662c9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/20/2025 00:46:08.905 7f80662c9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:08.916 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 00:46:08.987 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 00:46:08.988 7f8065955198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:08.988 7f8065955198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:08.988 7f8065955198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.097 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.42:5673//', 'pyamqp://guest:guest@10.0.0.12:5673//', 'pyamqp://guest:guest@10.0.0.47:5673//'] 03/20/2025 00:46:09.105 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 03/20/2025 00:46:09.106 7f806587b438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.106 7f806587b438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 00:46:09.106 7f806587b438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.106 7f806587b438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.106 7f806587b438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 00:46:09.107 7f806587b438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.116 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 03/20/2025 00:46:09.129 7f806572ac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.129 7f806572ac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:09.129 7f806572ac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.195 7f80662cb630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:09.197 7f80662cb630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:09.197 7f80662cb630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:09.197 7f80662cb630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:09.197 7f80662cb630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:09.197 7f80662cb630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:09.197 7f80662cb630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:09.197 7f80662cb630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:09.197 7f80662cb630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.198 7f80662cb630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:09.198 7f80662cb630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.198 7f80662cb630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.198 7f80662cb630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431549180079 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:46:09.198 7f80662cb630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.203 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 03/20/2025 00:46:09.204 7f806572c780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.204 7f806572c780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 00:46:09.204 7f806572c780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.211 7f806f54eb88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 03/20/2025 00:46:09.211 7f80662cb630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.211 7f80662cb630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:09.212 7f80662cb630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.213 7f806d711ac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 03/20/2025 00:46:09.214 7f80657a86d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.214 7f80657a86d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 00:46:09.214 7f80657a86d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.222 7f806d711ac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 03/20/2025 00:46:09.222 7f80657b4240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:09.222 7f80657b4240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:09.222 7f80657b4240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.684 7fabcc3c1508 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/20/2025 00:46:18.685 7fabcc3c1508 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/20/2025 00:46:18.685 7fabcc3c1508 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/20/2025 00:46:18.685 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.42:2181,10.0.0.12:2181,10.0.0.47:2181 03/20/2025 00:46:18.686 7fabcc3c1508 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 00:46:18.688 7fabc316deb8 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 03/20/2025 00:46:18.688 7fabc316deb8 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 03/20/2025 00:46:18.688 7fabc3171828 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 03/20/2025 00:46:18.688 7fabc3171828 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 00:46:18.689 7fabc3171828 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/20/2025 00:46:18.689 7fabc3171828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.689 7fabc3171828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 03/20/2025 00:46:18.689 7fabc3171828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.690 7fabc3171828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.690 7fabc3171828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 00:46:18.690 7fabc3171828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.690 7fabc3171828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.690 7fabc3171828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 03/20/2025 00:46:18.690 7fabc3171828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.698 7fabc319a438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.699 7fabc319a438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 00:46:18.699 7fabc319a438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.732 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.42:9041', '10.0.0.12:9041', '10.0.0.47:9041'] 03/20/2025 00:46:18.733 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 03/20/2025 00:46:18.733 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 00:46:18.733 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 00:46:18.734 7fabc2936cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.734 7fabc2936cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/20/2025 00:46:18.734 7fabc2936cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.743 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 00:46:18.790 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 00:46:18.792 7fabc295acc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.792 7fabc295acc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/20/2025 00:46:18.792 7fabc295acc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.801 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 00:46:18.802 7fabc79c88d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.802 7fabc79c88d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/20/2025 00:46:18.802 7fabc79c88d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.818 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 00:46:18.895 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 00:46:18.895 7fabc27eed68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:18.896 7fabc27eed68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 00:46:18.897 7fabc27eed68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.050 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.42:5673//', 'pyamqp://guest:guest@10.0.0.12:5673//', 'pyamqp://guest:guest@10.0.0.47:5673//'] 03/20/2025 00:46:19.066 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 03/20/2025 00:46:19.068 7fabc273a588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.070 7fabc273a588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 00:46:19.070 7fabc273a588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.070 7fabc273a588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.071 7fabc273a588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 00:46:19.071 7fabc273a588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.092 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 03/20/2025 00:46:19.093 7fabc2645ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.093 7fabc2645ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 00:46:19.093 7fabc2645ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.175 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 03/20/2025 00:46:19.176 7fabc2645e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.177 7fabc2645e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 00:46:19.177 7fabc2645e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.182 7fabcc3c1508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 03/20/2025 00:46:19.183 7fabc264a0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.183 7fabc264a0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 00:46:19.183 7fabc264a0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.184 7fabc273a588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 03/20/2025 00:46:19.184 7fabc26bd048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.185 7fabc26bd048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 00:46:19.185 7fabc26bd048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.190 7fabc273a588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 03/20/2025 00:46:19.191 7fabc26bda20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.191 7fabc26bda20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 00:46:19.191 7fabc26bda20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.548 7fabc9d5ed68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Executing db_resync on api-server instance 10.0.0.42_0 03/20/2025 00:46:19.548 7fabc9d5ed68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Contrail Version is(nightly-r24.1-centos) 03/20/2025 00:46:19.569 7fabc9d5ed68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: zk_sync_node data (nightly-r24.1-centos) 03/20/2025 00:46:19.573 7fabc9d5ed68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DBERESYNC: running walk 03/20/2025 00:46:19.592 7fabc9d5ed68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Cassandra DB walk completed. 03/20/2025 00:46:19.658 7fabc9d5ed68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Time elapsed in resyncing db: 0:00:00.109106 03/20/2025 00:46:19.673 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'discover_server_template'], 'obj_dict': {'display_name': 'Server Discovery', 'fq_name': ['default-global-system-config', 'discover_server_template'], 'id_perms': {'created': '2025-03-20T00:46:19.233005', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:19.233005', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12079522079891636897, 'uuid_mslong': 14056719668221331201}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "server info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, "ipmi": ' '{"$id": "/properties/ipmi", ' '"type": "object", "required": ' '["ipmi_subnet_list", ' '"ipmi_credentials"], "properties": ' '{"ipmi_subnet_list": {"$id": ' '"/properties/ipmi/properties/ipmi_subnet_list", ' '"type": "array", "items": {"$id": ' '"/properties/ipmi/properties/ipmi_subnet_list/items", ' '"type": "string", "description": ' '"List of the subnet prefixes that ' 'could be carved out for the p2p ' 'networks between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"ipmi_credentials": {"$id": ' '"/properties/ipmi/properties/ipmi_credentials", ' '"type": "array", "items": {"$id": ' '"/properties/ipmi/properties/ipmi_credentials/items", ' '"description": "The IPMI ' 'user:password credentials", ' '"type": "string"}}, ' '"ipmi_port_ranges": {"$id": ' '"/properties/ipmi/properties/ipmi_port_ranges", ' '"type": "array", "items": {"$id": ' '"/properties/ipmi/properties/ipmi_credentials/items", ' '"type": "object", "required": ' '["port_range_start", ' '"port_range_end"], "properties": ' '{"port_range_start": {"$id": ' '"/properties/ipmi/properties/ipmi_port_ranges/items/port_range_start", ' '"description": "Start of IPMI Port ' 'Range", "type": "integer"}, ' '"port_range_end": {"$id": ' '"/properties/ipmi/properties/ipmi_port_ranges/items/port_range_end", ' '"description": "End of IPMI Port ' 'Range", "type": "integer"}}}}}}, ' '"ironic": {"$id": ' '"/properties/ironic", "type": ' '"object", "required": ["auth_url", ' '"username", "password"], ' '"properties": {"auth_url": {"$id": ' '"/properties/ironic/properties/auth_url", ' '"description": "The Ironic Auth ' 'URL", "type": "string"}, ' '"username": {"$id": ' '"/properties/ironic/properties/username", ' '"description": "The Ironic Auth ' 'username", "type": "string"}, ' '"password": {"$id": ' '"/properties/ironic/properties/password", ' '"description": "The Ironic Auth ' 'password", "type": "string"}, ' '"introspection_flag": {"$id": ' '"/properties/ironic/properties/introspection_flag", ' '"description": "Flag to determine ' 'if introspection is needed", ' '"type": "boolean", "default": ' 'true}}}, "cc_username": {"$id": ' '"/properties/cc_username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/cc_password", "type": ' '"string"}, ' '"contrail_command_host": {"$id": ' '"/properties/contrail_command_host", ' '"type": "string"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_server.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c3138010-0394-4701-a7a3-1554e46dc2a1'}, 'oper': 'CREATE', 'request-id': 'req-3f4729af-30f0-4d06-81e8-a2c4c8d5f42e', 'type': 'job_template', 'uuid': 'c3138010-0394-4701-a7a3-1554e46dc2a1'} 03/20/2025 00:46:19.683 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-4d368242-c49c-4681-84f7-0e8e7a8527d1', 'type': 'application_policy_set', 'uuid': 'f045dcda-023e-429a-9f40-7ce2fc20afdb'} 03/20/2025 00:46:19.698 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 03/20/2025 00:46:19.699 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-99c4d371-88c5-4445-ad7c-1f137104d52a', 'type': 'network_ipam', 'uuid': 'f66b4c09-0c4c-42ef-ade0-dbf25202f4b2'} 03/20/2025 00:46:19.706 7fabca4ab048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.706 7fabca4ab048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]global_vrouter_config_refs : [{"to": ["default-global-system-config", "default-global-vrouter-config"], "attr": null, "uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7"}]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 17313487171394355866, "uuid_lslong": 11475309164874477531}, "enable": true, "created": "2025-03-20T00:46:09.353132", "last_modified": "2025-03-20T00:46:19.282323", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"parent_uuid : "c9f81784-63bb-4ab4-a557-daeb82ed1a4f"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "f045dcda-023e-429a-9f40-7ce2fc20afdb" } deleted = False >> 03/20/2025 00:46:19.706 7fabca4ab048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.720 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-2a6d25ca-6678-49e7-b25e-fd6358a77cfb', 'type': 'project', 'uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33'} 03/20/2025 00:46:19.729 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectProjectTable:ContrailConfigTrace] map 03/20/2025 00:46:19.730 7fabc273a4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.735 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 14339520150639034695, "uuid_lslong": 11157562497880332851}, "enable": true, "created": "2025-03-20T00:46:09.111489", "last_modified": "2025-03-20T00:46:19.615537", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "78cb90fb-efc3-49d9-aab8-3061c7ab1bd1"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}quota : {"defaults": -1}uuid : "c700359a-5c65-4147-9ad7-9ff9fd609a33" } deleted = False >> 03/20/2025 00:46:19.735 7fabc273a4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.742 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'server_import_template'], 'obj_dict': {'display_name': 'Server Import', 'fq_name': ['default-global-system-config', 'server_import_template'], 'id_perms': {'created': '2025-03-20T00:46:19.397693', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:19.397693', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10229023380861295155, 'uuid_mslong': 13155456102013813541}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "server import", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"encoded_file": {"$id": ' '"/properties/encoded_file", ' '"description": "The Encoded File ' 'to Import", "type": "string"}, ' '"file_format": {"$id": ' '"/properties/file_format", "type": ' '"string", "description": "The ' 'format of the encoded input file", ' '"enum": ["yaml", "json", "YAML", ' '"JSON"]}, "cc_username": {"$id": ' '"/properties/cc_username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/cc_password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, ' '"contrail_command_host": {"$id": ' '"/properties/contrail_command_host", ' '"description": "The Contrail ' 'Command IP", "type": "string"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/server_import.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b691919f-cac7-4325-8df4-ca91b7671a33'}, 'oper': 'CREATE', 'request-id': 'req-5558ac27-b858-4904-b513-16428e56466d', 'type': 'job_template', 'uuid': 'b691919f-cac7-4325-8df4-ca91b7671a33'} 03/20/2025 00:46:19.744 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'node_profile_template'], 'obj_dict': {'display_name': 'Node Profile', 'fq_name': ['default-global-system-config', 'node_profile_template'], 'id_perms': {'created': '2025-03-20T00:46:19.569608', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:19.569608', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9341075446618444068, 'uuid_mslong': 3259327720800928308}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "Node Profile Import", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"encoded_file": {"$id": ' '"/properties/encoded_file", ' '"description": "The Encoded File ' 'to Import", "type": "string"}, ' '"file_format": {"$id": ' '"/properties/file_format", "type": ' '"string", "description": "The ' 'format of the encoded input file", ' '"enum": ["yaml", "json", "YAML", ' '"JSON"]}, "cc_username": {"$id": ' '"/properties/cc_username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/cc_password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, ' '"contrail_command_host": {"$id": ' '"/properties/contrail_command_host", ' '"description": "The Contrail ' 'Command Hostname/IP", "type": ' '"string"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/node_profile.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2d3b754b-1cec-4234-81a2-2aa0a7d0d124'}, 'oper': 'CREATE', 'request-id': 'req-9757a2be-4c05-40bb-ab97-55b766636de7', 'type': 'job_template', 'uuid': '2d3b754b-1cec-4234-81a2-2aa0a7d0d124'} 03/20/2025 00:46:19.744 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-b8bdfebd-afd0-4eac-825e-a28e0328e817', 'type': 'network_ipam', 'uuid': 'f66b4c09-0c4c-42ef-ade0-dbf25202f4b2'} 03/20/2025 00:46:19.756 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-1f32fd68-938a-48da-8ce2-509cd1be3989', 'type': 'project', 'uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33'} 03/20/2025 00:46:19.763 7fabc9e85828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.763 7fabc9e85828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 14339520150639034695, "uuid_lslong": 11157562497880332851}, "enable": true, "created": "2025-03-20T00:46:09.111489", "last_modified": "2025-03-20T00:46:19.615537", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "78cb90fb-efc3-49d9-aab8-3061c7ab1bd1"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}quota : {"defaults": -1}uuid : "c700359a-5c65-4147-9ad7-9ff9fd609a33" } deleted = False >> 03/20/2025 00:46:19.763 7fabc9e85828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.830 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_mac_mob_template'], 'obj_dict': {'display_name': 'Show mac mobility', 'fq_name': ['default-global-system-config', 'show_mac_mob_template'], 'id_perms': {'created': '2025-03-20T00:46:19.763457', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:19.763457', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12817458353258757296, 'uuid_mslong': 6946604102051251707}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display MAC ' 'address move or mobility', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"mac_details": ' '{"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "MAC Details", "type": ' '"object", "properties": ' '{"mac_address": {"$id": ' '"/properties/mac_address", ' '"title": "Mac Address", "pattern": ' '"^\\\\s*([A-Fa-f0-9]{2}(:{1}[A-Fa-f0-9]{2}){5})\\\\s*$", ' '"type": "string"}}, "required": ' '["mac_address"]}}}', 'job_template_input_ui_schema': '{"mac_details": {"mac_address": ' '{"ui:help": "Enter a 48 bit MAC ' 'address in colon separated ' 'format; for example, ' '00:00:0A:BB:28:FC", ' '"ui:placeholder": "Enter MAC ' 'address"}}}', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show MAC mobility ' 'Output", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "MAC History", ' '"description": "Display Device ' 'Configuration output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '60674ba0-4a09-45fb-b1e0-c2766559fcb0'}, 'oper': 'CREATE', 'request-id': 'req-b5145ce1-f67d-415e-b063-eec9d9c046b2', 'type': 'job_template', 'uuid': '60674ba0-4a09-45fb-b1e0-c2766559fcb0'} 03/20/2025 00:46:19.892 7fabcc3c1508 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 03/20/2025 00:46:19.894 7fabcbeb82e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.894 7fabcbeb82e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ModuleCpuStateTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-17 00:13:07.143810", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8139-1.novalocal", "build-id" : "1", "build-number" : "centos"}]} config_node_ip = [ 10.0.0.42, 10.20.0.11, 172.17.0.1, ] >> 03/20/2025 00:46:19.894 7fabcbeb82e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:20.074 7fabc24c4630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:20.078 7fabc24c4630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Generic Connection:Keystone[] connection down >>, ] >> 03/20/2025 00:46:20.078 7fabc24c4630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:20.100 7fabc28a1f60 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Starting consumer greenlet 03/20/2025 00:46:20.101 7fabc28a1f60 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Consumer connection 03/20/2025 00:46:20.101 7fabc28a1b70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Starting publisher greenlet 03/20/2025 00:46:20.101 7fabc28a1b70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Publisher connection 03/20/2025 00:46:20.102 7fabcc3c1508 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Added consumer: amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy 03/20/2025 00:46:20.102 7fabcc3c1508 [contrail-api] [DEBUG]: Add uve in the [none:ConfigApiWorkerTrace] map 03/20/2025 00:46:20.103 7fabc48f9630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:20.103 7fabc48f9630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ConfigApiWorkerTrace: data = << name = worker-0 worker_id = 0 introspect_port = 8084 admin_port = 8095 introspect_url = http://10.0.0.42:8084 >> 03/20/2025 00:46:20.103 7fabc48f9630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:20.127 7fabc28a1b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Publisher connection established 03/20/2025 00:46:20.127 7fabc28a1f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 03/20/2025 00:46:20.161 7fabc28a1f60 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy'] 03/20/2025 00:46:20.204 7fabc28a1f60 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Consumer connection 03/20/2025 00:46:20.209 7fabc28a1f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 03/20/2025 00:46:20.278 7fabc28a1f60 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy'] 03/20/2025 00:46:21.713 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-079bce1f-cdab-475f-a801-ca644425a2f2', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 00:46:22.134 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-fb15f0c4-d087-4c39-8c68-500eb1986b55', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 00:46:22.259 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rma_activate_template'], 'obj_dict': {'display_name': 'RMA Activation', 'fq_name': ['default-global-system-config', 'rma_activate_template'], 'id_perms': {'created': '2025-03-20T00:46:22.221340', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:22.221340', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10538889210535040322, 'uuid_mslong': 10658530536154353549}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "RMA activate", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"type": "string", "description": ' '"Fabric UUID"}, "rma_devices": ' '{"type": "array", "items": ' '{"title": "RMA Devices", "type": ' '"object", "description": "List of ' 'devices and corresponding serial ' 'numbers to RMA", ' '"additionalProperties": false, ' '"properties": {"device_uuid": ' '{"type": "string", "format": ' '"uuid"}, "serial_number": {"type": ' '"string"}}, "required": ' '["device_uuid", ' '"serial_number"]}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/rma_activate.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 50, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml', 'refresh_token': False, 'sequence_no': 2, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 20, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': 3, 'vendor': 'Juniper'}]}, 'job_template_recovery_playbooks': {'playbook_info': [{'device_family': None, 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': None}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '93eab50d-2322-4f8d-9241-a7e649235542'}, 'oper': 'CREATE', 'request-id': 'req-92a8a661-44cb-4264-9bf3-10c88483dd6f', 'type': 'job_template', 'uuid': '93eab50d-2322-4f8d-9241-a7e649235542'} 03/20/2025 00:46:22.537 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-f3ee7042-d420-4626-a75a-8ae087f2161c', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 00:46:22.691 7fabc2268390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:22.692 7fabc2268390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:22.692 7fabc2268390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:22.692 7fabc2268390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:22.692 7fabc2268390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Generic Connection:Keystone[] connection down >>, ] >> 03/20/2025 00:46:22.692 7fabc2268390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:22.692 7fabc2268390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:22.693 7fabc2268390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:22.693 7fabc2268390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:22.693 7fabc2268390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Generic Connection:Keystone[] connection down >>, ] >> 03/20/2025 00:46:22.693 7fabc2268390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:22.693 7fabc2268390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:22.693 7fabc2268390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:46:22.693 7fabc2268390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:23.838 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_chassis_info_template'], 'obj_dict': {'display_name': 'Show chassis information', 'fq_name': ['default-global-system-config', 'show_chassis_info_template'], 'id_perms': {'created': '2025-03-20T00:46:23.774319', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:23.774319', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12073558002279444108, 'uuid_mslong': 2599522805385416158}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display ' 'chassis information', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"chassis": {"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "Chassis information", ' '"type": "object", "properties": ' '{"chassis_detail": {"$id": ' '"/properties/chassis_detail", ' '"title": "Chassis detail", "type": ' '"string", "enum": ["chassis ' 'alarms", "chassis environment", ' '"chassis environment cb", "chassis ' 'environment fpc", "chassis ' 'environment pem", "chassis ' 'environment routing-engine", ' '"chassis fpc detail", "chassis ' 'fan", "chassis firmware", "chassis ' 'mac-addresses", "chassis ' 'routing-engine", "chassis power", ' '"chassis hardware", "chassis ' 'hardware detail", "chassis ' 'hardware clei-models", "chassis ' 'temperature-thresholds"], ' '"default": "chassis hardware"}}, ' '"required": ["chassis_detail"]}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show chassis Output", ' '"type": "object", "properties": ' '{"results": {"type": "array", ' '"description": "Array holding the ' 'specific output details in case ' 'of success. Each object of the ' 'array would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "Chassis ' 'info", "description": "Display ' 'Device Configuration ' 'output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '24135c37-f886-4dde-a78d-e508dcf0ee8c'}, 'oper': 'CREATE', 'request-id': 'req-78de0adf-99d8-4f55-8f80-e76a7ff82810', 'type': 'job_template', 'uuid': '24135c37-f886-4dde-a78d-e508dcf0ee8c'} 03/20/2025 00:46:23.849 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:hardware_inventory_template url = http://10.0.0.42:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "hardware_inventory_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Hardware Inventory Information\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"minProperties\": 1}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to fetch hardware inventory information from the device", "display_name": "Fetch hardware chassis information", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:23.960 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'hardware_inventory_template'], 'obj_dict': {'display_name': 'Fetch hardware chassis information', 'fq_name': ['default-global-system-config', 'hardware_inventory_template'], 'id_perms': {'created': '2025-03-20T00:46:23.942611', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:23.942611', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9562519637221521776, 'uuid_mslong': 4267601439979225332}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to fetch ' 'hardware inventory information from ' 'the device', 'job_template_input_schema': '{"title": "Hardware Inventory ' 'Information", "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", "minProperties": ' '1}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3b3990e6-20e8-40f4-84b4-e4f216493970'}, 'oper': 'CREATE', 'request-id': 'req-a2b479ee-7bfe-4460-b8bd-18ea200014d9', 'type': 'job_template', 'uuid': '3b3990e6-20e8-40f4-84b4-e4f216493970'} 03/20/2025 00:46:24.071 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'config_property'], 'obj_dict': {'display_name': 'Config Property', 'fq_name': ['default-global-system-config', 'config_property'], 'id_perms': {'created': '2025-03-20T00:46:24.049247', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:24.049247', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12134014582436418296, 'uuid_mslong': 9603664219981235525}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'properties': {'key_value_pair': [{'key': 'junos_commit_timeout', 'value': '600'}, {'key': 'total_retry_timeout', 'value': '600'}, {'key': 'device_command_timeout', 'value': '600'}, {'key': 'ztp_timeout', 'value': '570'}]}, 'uuid': '854711b9-c61c-4545-a864-adf9558852f8'}, 'oper': 'CREATE', 'request-id': 'req-48e3456c-cf3a-4575-b586-5cd7c62d04b5', 'type': 'config_properties', 'uuid': '854711b9-c61c-4545-a864-adf9558852f8'} 03/20/2025 00:46:24.207 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-management-ip'], 'obj_dict': {'display_name': 'label=fabric-management-ip', 'fq_name': ['label=fabric-management-ip'], 'id_perms': {'created': '2025-03-20T00:46:24.154841', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:24.154841', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9871026443555300497, 'uuid_mslong': 3048788518851986406}}, 'name': 'label=fabric-management-ip', 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000000', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'a9f1e732-9ca7-4cb9-af4d-3e0460e50730'}], 'tag_value': 'fabric-management-ip', 'uuid': '2a4f7901-3576-43e6-88fc-ee406099e491'}, 'oper': 'CREATE', 'request-id': 'req-faff51c0-6274-4316-840e-341d2e257e05', 'type': 'tag', 'uuid': '2a4f7901-3576-43e6-88fc-ee406099e491'} 03/20/2025 00:46:24.208 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:46:24.208 7fabc2262438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:24.208 7fabc2262438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-management-ip elements = { display_name : "label=fabric-management-ip"fq_name : ["label=fabric-management-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3048788518851986406, "uuid_lslong": 9871026443555300497}, "enable": true, "created": "2025-03-20T00:46:24.154841", "last_modified": "2025-03-20T00:46:24.154841", "description": null, "user_visible": true, "creator": null}name : "label=fabric-management-ip"perms2 : {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000000"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "a9f1e732-9ca7-4cb9-af4d-3e0460e50730", "to": ["label"]}]tag_value : "fabric-management-ip"uuid : "2a4f7901-3576-43e6-88fc-ee406099e491" } deleted = False >> 03/20/2025 00:46:24.208 7fabc2262438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:24.219 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-loopback-ip url = http://10.0.0.42:8082/tags operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-loopback-ip"], "tag_type_name": "label", "tag_value": "fabric-loopback-ip", "tag_predefined": true, "name": "label=fabric-loopback-ip", "display_name": "label=fabric-loopback-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:24.287 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-loopback-ip'], 'obj_dict': {'display_name': 'label=fabric-loopback-ip', 'fq_name': ['label=fabric-loopback-ip'], 'id_perms': {'created': '2025-03-20T00:46:24.254931', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:24.254931', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13455874503408437926, 'uuid_mslong': 2305389086802920968}}, 'name': 'label=fabric-loopback-ip', 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000001', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'a9f1e732-9ca7-4cb9-af4d-3e0460e50730'}], 'tag_value': 'fabric-loopback-ip', 'uuid': '1ffe6328-f3f3-4608-babc-de918de54aa6'}, 'oper': 'CREATE', 'request-id': 'req-de026447-9150-4a53-a5fb-dff3212a331b', 'type': 'tag', 'uuid': '1ffe6328-f3f3-4608-babc-de918de54aa6'} 03/20/2025 00:46:24.288 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:46:24.288 7fabc2256eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:24.288 7fabc2256eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-loopback-ip elements = { display_name : "label=fabric-loopback-ip"fq_name : ["label=fabric-loopback-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2305389086802920968, "uuid_lslong": 13455874503408437926}, "enable": true, "created": "2025-03-20T00:46:24.254931", "last_modified": "2025-03-20T00:46:24.254931", "description": null, "user_visible": true, "creator": null}name : "label=fabric-loopback-ip"perms2 : {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000001"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "a9f1e732-9ca7-4cb9-af4d-3e0460e50730", "to": ["label"]}]tag_value : "fabric-loopback-ip"uuid : "1ffe6328-f3f3-4608-babc-de918de54aa6" } deleted = False >> 03/20/2025 00:46:24.288 7fabc2256eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:24.387 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-overlay-loopback-ip'], 'obj_dict': {'display_name': 'label=fabric-overlay-loopback-ip', 'fq_name': ['label=fabric-overlay-loopback-ip'], 'id_perms': {'created': '2025-03-20T00:46:24.345666', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:24.345666', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11007746968744552372, 'uuid_mslong': 17974918004586989107}}, 'name': 'label=fabric-overlay-loopback-ip', 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000002', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'a9f1e732-9ca7-4cb9-af4d-3e0460e50730'}], 'tag_value': 'fabric-overlay-loopback-ip', 'uuid': 'f973bcb0-a22e-4633-98c3-5f8be966e7b4'}, 'oper': 'CREATE', 'request-id': 'req-acbe26ff-ce9c-4466-a245-9bf40b19670d', 'type': 'tag', 'uuid': 'f973bcb0-a22e-4633-98c3-5f8be966e7b4'} 03/20/2025 00:46:24.387 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:46:24.389 7fabc2268198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:24.389 7fabc2268198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-overlay-loopback-ip elements = { display_name : "label=fabric-overlay-loopback-ip"fq_name : ["label=fabric-overlay-loopback-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 17974918004586989107, "uuid_lslong": 11007746968744552372}, "enable": true, "created": "2025-03-20T00:46:24.345666", "last_modified": "2025-03-20T00:46:24.345666", "description": null, "user_visible": true, "creator": null}name : "label=fabric-overlay-loopback-ip"perms2 : {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000002"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "a9f1e732-9ca7-4cb9-af4d-3e0460e50730", "to": ["label"]}]tag_value : "fabric-overlay-loopback-ip"uuid : "f973bcb0-a22e-4633-98c3-5f8be966e7b4" } deleted = False >> 03/20/2025 00:46:24.390 7fabc2268198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:24.530 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-peer-ip'], 'obj_dict': {'display_name': 'label=fabric-peer-ip', 'fq_name': ['label=fabric-peer-ip'], 'id_perms': {'created': '2025-03-20T00:46:24.479590', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:24.479590', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11537785494426366291, 'uuid_mslong': 4939176435978879055}}, 'name': 'label=fabric-peer-ip', 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000003', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'a9f1e732-9ca7-4cb9-af4d-3e0460e50730'}], 'tag_value': 'fabric-peer-ip', 'uuid': '448b7acc-b580-404f-a01e-72c701f03153'}, 'oper': 'CREATE', 'request-id': 'req-ac21c0e4-4f57-40ab-a459-a256f2536632', 'type': 'tag', 'uuid': '448b7acc-b580-404f-a01e-72c701f03153'} 03/20/2025 00:46:24.530 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:46:24.530 7fabc264ab70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:24.531 7fabc264ab70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-peer-ip elements = { display_name : "label=fabric-peer-ip"fq_name : ["label=fabric-peer-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 4939176435978879055, "uuid_lslong": 11537785494426366291}, "enable": true, "created": "2025-03-20T00:46:24.479590", "last_modified": "2025-03-20T00:46:24.479590", "description": null, "user_visible": true, "creator": null}name : "label=fabric-peer-ip"perms2 : {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000003"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "a9f1e732-9ca7-4cb9-af4d-3e0460e50730", "to": ["label"]}]tag_value : "fabric-peer-ip"uuid : "448b7acc-b580-404f-a01e-72c701f03153" } deleted = False >> 03/20/2025 00:46:24.531 7fabc264ab70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:24.566 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-pnf-servicechain-ip url = http://10.0.0.42:8082/tags operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-pnf-servicechain-ip"], "tag_type_name": "label", "tag_value": "fabric-pnf-servicechain-ip", "tag_predefined": true, "name": "label=fabric-pnf-servicechain-ip", "display_name": "label=fabric-pnf-servicechain-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:24.590 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig has a list of elements - it should be a dict. Controllers have inconsistency in their data.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-elements-inconsistency"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:24.624 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig has a list of elements - it should be a dict. Controllers have inconsistency in their data.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-elements-inconsistency"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:24.648 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.42:8082/alarms operation = IDs allocation useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig has a list of elements - it should be a dict. Controllers have inconsistency in their data.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-elements-inconsistency", "parent_uuid": "92e769a6-5754-45f5-bd68-145125efbf0e"}} domain = default-domain project = admin user = admin error = alarm:FQ Name: /fq-name-to-uuid/alarm:default-global-system-config:system-defined-conf-elements-inconsistency exists already with ID: 3688031d-5203-42b0-ac58-7dcd46cf5ea1 at zookeeper >> 03/20/2025 00:46:24.656 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements', 'operand2': {'json_value': '1'}, 'operation': 'size=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-elements-inconsistency', 'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'id_perms': {'created': '2025-03-20T00:46:24.626597', 'creator': None, 'description': 'ContrailConfig has a list of ' 'elements - it should be a dict. ' 'Controllers have inconsistency in ' 'their data.', 'enable': True, 'last_modified': '2025-03-20T00:46:24.626597', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12418814293083905697, 'uuid_mslong': 3929394099345638064}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3688031d-5203-42b0-ac58-7dcd46cf5ea1', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-751a8a01-4ab8-4abb-8db7-90cfba3e9d63', 'type': 'alarm', 'uuid': '3688031d-5203-42b0-ac58-7dcd46cf5ea1'} 03/20/2025 00:46:24.671 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-pnf-servicechain-ip'], 'obj_dict': {'display_name': 'label=fabric-pnf-servicechain-ip', 'fq_name': ['label=fabric-pnf-servicechain-ip'], 'id_perms': {'created': '2025-03-20T00:46:24.620817', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:24.620817', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11005475197459986700, 'uuid_mslong': 3661088611383525651}}, 'name': 'label=fabric-pnf-servicechain-ip', 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000004', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'a9f1e732-9ca7-4cb9-af4d-3e0460e50730'}], 'tag_value': 'fabric-pnf-servicechain-ip', 'uuid': '32ceccb1-dcbe-4113-98bb-4d61f0f9790c'}, 'oper': 'CREATE', 'request-id': 'req-2c297ef2-a42c-48fc-8a6b-f74b5aa015c2', 'type': 'tag', 'uuid': '32ceccb1-dcbe-4113-98bb-4d61f0f9790c'} 03/20/2025 00:46:24.672 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:46:24.672 7fabc220e240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:24.672 7fabc220e240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-pnf-servicechain-ip elements = { display_name : "label=fabric-pnf-servicechain-ip"fq_name : ["label=fabric-pnf-servicechain-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3661088611383525651, "uuid_lslong": 11005475197459986700}, "enable": true, "created": "2025-03-20T00:46:24.620817", "last_modified": "2025-03-20T00:46:24.620817", "description": null, "user_visible": true, "creator": null}name : "label=fabric-pnf-servicechain-ip"perms2 : {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000004"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "a9f1e732-9ca7-4cb9-af4d-3e0460e50730", "to": ["label"]}]tag_value : "fabric-pnf-servicechain-ip"uuid : "32ceccb1-dcbe-4113-98bb-4d61f0f9790c" } deleted = False >> 03/20/2025 00:46:24.672 7fabc220e240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:24.687 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Compute Node IP Address mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-address-mismatch-compute"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:24.712 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3688031d-5203-42b0-ac58-7dcd46cf5ea1 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.42:8082/alarm/3688031d-5203-42b0-ac58-7dcd46cf5ea1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "3688031d-5203-42b0-ac58-7dcd46cf5ea1", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:24.729 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_ip_address', 'operand2': {'uve_attribute': 'VrouterAgent.control_ip'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-compute', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'id_perms': {'created': '2025-03-20T00:46:24.721253', 'creator': None, 'description': 'Compute Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-03-20T00:46:24.721253', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11522447549170542209, 'uuid_mslong': 6265688005056480539}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '56f4320b-26d1-451b-9fe7-f4ff57616681', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-ff44e105-d6ed-454a-9534-c24efea1d033', 'type': 'alarm', 'uuid': '56f4320b-26d1-451b-9fe7-f4ff57616681'} 03/20/2025 00:46:24.754 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-5abe2df1-98cd-456f-8ebf-b5d13abe50af', 'type': 'alarm', 'uuid': '3688031d-5203-42b0-ac58-7dcd46cf5ea1'} 03/20/2025 00:46:24.767 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-as-number'], 'obj_dict': {'display_name': 'label=fabric-as-number', 'fq_name': ['label=fabric-as-number'], 'id_perms': {'created': '2025-03-20T00:46:24.722534', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:24.722534', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9665435443567354204, 'uuid_mslong': 3492372343184967870}}, 'name': 'label=fabric-as-number', 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000005', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'a9f1e732-9ca7-4cb9-af4d-3e0460e50730'}], 'tag_value': 'fabric-as-number', 'uuid': '30776624-8af0-48be-8622-8653854d615c'}, 'oper': 'CREATE', 'request-id': 'req-a2fadf66-f5e8-4967-b788-3fa1c222fc91', 'type': 'tag', 'uuid': '30776624-8af0-48be-8622-8653854d615c'} 03/20/2025 00:46:24.768 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:46:24.768 7fabc29280f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:24.768 7fabc29280f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-as-number elements = { display_name : "label=fabric-as-number"fq_name : ["label=fabric-as-number"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3492372343184967870, "uuid_lslong": 9665435443567354204}, "enable": true, "created": "2025-03-20T00:46:24.722534", "last_modified": "2025-03-20T00:46:24.722534", "description": null, "user_visible": true, "creator": null}name : "label=fabric-as-number"perms2 : {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000005"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "a9f1e732-9ca7-4cb9-af4d-3e0460e50730", "to": ["label"]}]tag_value : "fabric-as-number"uuid : "30776624-8af0-48be-8622-8653854d615c" } deleted = False >> 03/20/2025 00:46:24.769 7fabc29280f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:24.788 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Control Node IP Address mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-address-mismatch-control"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:24.806 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3688031d-5203-42b0-ac58-7dcd46cf5ea1 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.42:8082/alarm/3688031d-5203-42b0-ac58-7dcd46cf5ea1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "3688031d-5203-42b0-ac58-7dcd46cf5ea1", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:24.840 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-3908db82-6c8a-4e5d-b1c0-eb5b6790a995', 'type': 'alarm', 'uuid': '3688031d-5203-42b0-ac58-7dcd46cf5ea1'} 03/20/2025 00:46:24.863 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.bgp_router_parameters.address', 'operand2': {'uve_attribute': 'BgpRouterState.bgp_router_ip_list'}, 'operation': 'not ' 'in'}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-control', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'id_perms': {'created': '2025-03-20T00:46:24.846486', 'creator': None, 'description': 'Control Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-03-20T00:46:24.846486', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9897443876708838878, 'uuid_mslong': 18085480240745562932}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fafc8875-3dfc-4334-895a-c8c457986dde', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-5d8e35de-323e-4a26-8342-d2c43169459e', 'type': 'alarm', 'uuid': 'fafc8875-3dfc-4334-895a-c8c457986dde'} 03/20/2025 00:46:24.880 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-ebgp-as-number'], 'obj_dict': {'display_name': 'label=fabric-ebgp-as-number', 'fq_name': ['label=fabric-ebgp-as-number'], 'id_perms': {'created': '2025-03-20T00:46:24.845142', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:24.845142', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11011602193795844533, 'uuid_mslong': 17117542214302518448}}, 'name': 'label=fabric-ebgp-as-number', 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000006', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'a9f1e732-9ca7-4cb9-af4d-3e0460e50730'}], 'tag_value': 'fabric-ebgp-as-number', 'uuid': 'ed8db9f3-8741-4cb0-98d1-11da711d09b5'}, 'oper': 'CREATE', 'request-id': 'req-a1d69387-d008-489b-8922-c4366033799f', 'type': 'tag', 'uuid': 'ed8db9f3-8741-4cb0-98d1-11da711d09b5'} 03/20/2025 00:46:24.881 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:46:24.881 7fabc21a5390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:24.881 7fabc21a5390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-ebgp-as-number elements = { display_name : "label=fabric-ebgp-as-number"fq_name : ["label=fabric-ebgp-as-number"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 17117542214302518448, "uuid_lslong": 11011602193795844533}, "enable": true, "created": "2025-03-20T00:46:24.845142", "last_modified": "2025-03-20T00:46:24.845142", "description": null, "user_visible": true, "creator": null}name : "label=fabric-ebgp-as-number"perms2 : {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000006"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "a9f1e732-9ca7-4cb9-af4d-3e0460e50730", "to": ["label"]}]tag_value : "fabric-ebgp-as-number"uuid : "ed8db9f3-8741-4cb0-98d1-11da711d09b5" } deleted = False >> 03/20/2025 00:46:24.881 7fabc21a5390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:24.903 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/global-system-config/92e769a6-5754-45f5-bd68-145125efbf0e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"global-system-config": {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "fq_name": ["default-global-system-config"], "supported_device_families": {"device_family": ["junos", "junos-qfx"]}, "supported_vendor_hardwares": {"vendor_hardware": ["juniper-qfx10002-72q", "juniper-qfx10002-36q", "juniper-qfx10002-60c", "juniper-qfx10016", "juniper-qfx10008", "juniper-vqfx-10000", "juniper-qfx5100-48sh-afi", "juniper-qfx5100-48sh-afo", "juniper-qfx5100-48th-afi", "juniper-qfx5100-48th-afo", "juniper-qfx5100-48s-6q", "juniper-qfx5100-96s-8q", "juniper-qfx5100-48t", "juniper-qfx5100-48t-6q", "juniper-qfx5100-24q-2p", "juniper-qfx5100-24q-aa", "juniper-qfx5100e-48s-6q", "juniper-qfx5100e-96s-8q", "juniper-qfx5100e-48t-6q", "juniper-qfx5100e-24q-2p", "juniper-qfx5110-48s-4c", "juniper-qfx5110-32q", "juniper-qfx5120-48y-8c", "juniper-qfx5120-48t-6c", "juniper-qfx5120-32c", "juniper-qfx5220-32cd", "juniper-qfx5220-128c", "juniper-qfx5200-32c-32q", "juniper-qfx5200-48y", "juniper-qfx5210-64c", "juniper-vmx", "juniper-mx80", "juniper-mx80-48t", "juniper-mx204", "juniper-mx240", "juniper-mx480", "juniper-mx960", "juniper-mx2008", "juniper-mx2010", "juniper-mx2020", "juniper-mx10003", "juniper-jnp10008", "juniper-jnp10016", "juniper-srx5400", "juniper-srx5600", "juniper-srx4600", "juniper-srx4100", "juniper-srx1500", "juniper-srx240h-poe", "juniper-vsrx", "juniper-srx5800", "juniper-srx4200"]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:24.922 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "BGP peer mismatch. Not enough BGP peers are up.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-bgp-connectivity"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:24.952 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 56f4320b-26d1-451b-9fe7-f4ff57616681 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.42:8082/alarm/56f4320b-26d1-451b-9fe7-f4ff57616681 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "56f4320b-26d1-451b-9fe7-f4ff57616681", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:24.964 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-afda3320-c7bd-4719-8022-09e4e5d22418', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 00:46:25.003 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 56f4320b-26d1-451b-9fe7-f4ff57616681 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.42:8082/alarm/56f4320b-26d1-451b-9fe7-f4ff57616681 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "56f4320b-26d1-451b-9fe7-f4ff57616681", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.014 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48sh-afi'], 'obj_dict': {'display_name': 'juniper-qfx5100-48sh-afi', 'fq_name': ['juniper-qfx5100-48sh-afi'], 'id_perms': {'created': '2025-03-20T00:46:24.989247', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:24.989247', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11016478860916436372, 'uuid_mslong': 12617214031315224834}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'af195950-079e-4902-98e2-6527fc862d94'}, 'oper': 'CREATE', 'request-id': 'req-399ea69b-a050-4f71-b8df-d29c5ae88efe', 'type': 'hardware', 'uuid': 'af195950-079e-4902-98e2-6527fc862d94'} 03/20/2025 00:46:25.026 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_bgp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-bgp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'id_perms': {'created': '2025-03-20T00:46:25.006906', 'creator': None, 'description': 'BGP peer mismatch. Not enough BGP ' 'peers are up.', 'enable': True, 'last_modified': '2025-03-20T00:46:25.006906', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12327217757165330682, 'uuid_mslong': 16187913031947338123}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e0a70522-a423-418b-ab13-133cdcba20fa', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-eaf7f153-4591-4bdb-bfd6-071e1829d291', 'type': 'alarm', 'uuid': 'e0a70522-a423-418b-ab13-133cdcba20fa'} 03/20/2025 00:46:25.039 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-686804d4-4c9e-4ef3-9c5f-50d1c7ae2608', 'type': 'alarm', 'uuid': '56f4320b-26d1-451b-9fe7-f4ff57616681'} 03/20/2025 00:46:25.059 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-fd8e2087-812d-496d-8e3f-a99cd8ef64fa', 'type': 'alarm', 'uuid': '56f4320b-26d1-451b-9fe7-f4ff57616681'} 03/20/2025 00:46:25.073 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48sh-afo'], 'obj_dict': {'display_name': 'juniper-qfx5100-48sh-afo', 'fq_name': ['juniper-qfx5100-48sh-afo'], 'id_perms': {'created': '2025-03-20T00:46:25.059099', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.059099', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10961984568596574416, 'uuid_mslong': 12240623464321598644}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'a9df6e2f-ec33-44b4-9820-cae2d48330d0'}, 'oper': 'CREATE', 'request-id': 'req-6526003f-f38c-4d9e-8f6b-3f8f5e0fea9a', 'type': 'hardware', 'uuid': 'a9df6e2f-ec33-44b4-9820-cae2d48330d0'} 03/20/2025 00:46:25.086 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48th-afi url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48th-afi"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48th-afi"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.095 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-incorrect"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.120 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48th-afi'], 'obj_dict': {'display_name': 'juniper-qfx5100-48th-afi', 'fq_name': ['juniper-qfx5100-48th-afi'], 'id_perms': {'created': '2025-03-20T00:46:25.112961', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.112961', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12634244744229887696, 'uuid_mslong': 9739177814163671665}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '8728829f-2197-4a71-af55-daa7e12b1ed0'}, 'oper': 'CREATE', 'request-id': 'req-0ca53b42-7463-4e94-85d1-d7e67e68fbd8', 'type': 'hardware', 'uuid': '8728829f-2197-4a71-af55-daa7e12b1ed0'} 03/20/2025 00:46:25.165 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-incorrect', 'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'id_perms': {'created': '2025-03-20T00:46:25.158090', 'creator': None, 'description': 'ContrailConfig missing or ' 'incorrect. Configuration pushed to ' 'Ifmap as ContrailConfig is ' 'missing/incorrect.', 'enable': True, 'last_modified': '2025-03-20T00:46:25.158090', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13381855457098260765, 'uuid_mslong': 12767291214053527226}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-b189a0d8-0c6f-45ca-8474-b72768a0c418', 'type': 'alarm', 'uuid': 'b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d'} 03/20/2025 00:46:25.179 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48th-afo'], 'obj_dict': {'display_name': 'juniper-qfx5100-48th-afo', 'fq_name': ['juniper-qfx5100-48th-afo'], 'id_perms': {'created': '2025-03-20T00:46:25.156202', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.156202', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10820187774718463935, 'uuid_mslong': 7272797577940189643}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '64ee2add-3c72-41cb-9629-07740b1e4fbf'}, 'oper': 'CREATE', 'request-id': 'req-7ae8b8c1-ebe9-4704-9e75-462bfdb80c09', 'type': 'hardware', 'uuid': '64ee2add-3c72-41cb-9629-07740b1e4fbf'} 03/20/2025 00:46:25.190 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fafc8875-3dfc-4334-895a-c8c457986dde object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.42:8082/alarm/fafc8875-3dfc-4334-895a-c8c457986dde operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "fafc8875-3dfc-4334-895a-c8c457986dde", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.201 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fafc8875-3dfc-4334-895a-c8c457986dde object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.42:8082/alarm/fafc8875-3dfc-4334-895a-c8c457986dde operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "fafc8875-3dfc-4334-895a-c8c457986dde", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.222 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48s-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100-48s-6q', 'fq_name': ['juniper-qfx5100-48s-6q'], 'id_perms': {'created': '2025-03-20T00:46:25.209435', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.209435', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13125852759544704005, 'uuid_mslong': 18208379267492170486}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'fcb12878-be75-4af6-b628-658a82be2c05'}, 'oper': 'CREATE', 'request-id': 'req-8c784c8e-4968-4f14-94ab-7e4db3d45d6f', 'type': 'hardware', 'uuid': 'fcb12878-be75-4af6-b628-658a82be2c05'} 03/20/2025 00:46:25.238 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-96s-8q url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-96s-8q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-96s-8q"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.247 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Disk usage crosses high threshold limit.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-disk-usage-high"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.276 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-96s-8q'], 'obj_dict': {'display_name': 'juniper-qfx5100-96s-8q', 'fq_name': ['juniper-qfx5100-96s-8q'], 'id_perms': {'created': '2025-03-20T00:46:25.250708', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.250708', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13716215293118734882, 'uuid_mslong': 13113814404635707298}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'b5fda0b8-96b6-47a2-be59-c923311f6222'}, 'oper': 'CREATE', 'request-id': 'req-b015bbc5-4c74-47ca-8ebf-0fb7a724d753', 'type': 'hardware', 'uuid': 'b5fda0b8-96b6-47a2-be59-c923311f6222'} 03/20/2025 00:46:25.285 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-1083096c-d030-483c-bfe0-0f4b1379a536', 'type': 'alarm', 'uuid': 'fafc8875-3dfc-4334-895a-c8c457986dde'} 03/20/2025 00:46:25.303 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-6b362ac2-1fcd-48a0-904b-3a69e77fc01e', 'type': 'alarm', 'uuid': 'fafc8875-3dfc-4334-895a-c8c457986dde'} 03/20/2025 00:46:25.363 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '[70, ' '90]'}, 'operation': 'range', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-disk-usage-high', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'id_perms': {'created': '2025-03-20T00:46:25.327474', 'creator': None, 'description': 'Disk usage crosses high threshold ' 'limit.', 'enable': True, 'last_modified': '2025-03-20T00:46:25.327474', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12672991922751404974, 'uuid_mslong': 10316443568031681534}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8f2b5ec4-29e4-4bfe-afdf-830264fdfbae', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-a1333e89-e8f7-4b94-919a-eb338cc6acf9', 'type': 'alarm', 'uuid': '8f2b5ec4-29e4-4bfe-afdf-830264fdfbae'} 03/20/2025 00:46:25.374 7fabc2131630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:25.374 7fabc2131630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:25.374 7fabc2131630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:25.383 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48t'], 'obj_dict': {'display_name': 'juniper-qfx5100-48t', 'fq_name': ['juniper-qfx5100-48t'], 'id_perms': {'created': '2025-03-20T00:46:25.358058', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.358058', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10898354537791130072, 'uuid_mslong': 12281080477496000725}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'aa6f29a0-5722-40d5-973e-bbb5cd4e89d8'}, 'oper': 'CREATE', 'request-id': 'req-fc6d5d82-86ea-43bd-aa66-456d7ecfea00', 'type': 'hardware', 'uuid': 'aa6f29a0-5722-40d5-973e-bbb5cd4e89d8'} 03/20/2025 00:46:25.423 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Disk usage crosses critical threshold limit.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-disk-usage-critical"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.424 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e0a70522-a423-418b-ab13-133cdcba20fa object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.42:8082/alarm/e0a70522-a423-418b-ab13-133cdcba20fa operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "e0a70522-a423-418b-ab13-133cdcba20fa", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.441 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48t-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100-48t-6q', 'fq_name': ['juniper-qfx5100-48t-6q'], 'id_perms': {'created': '2025-03-20T00:46:25.429472', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.429472', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12498792417280171966, 'uuid_mslong': 2102413760402704265}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '1d2d462d-0fb2-4789-ad74-a17b69549fbe'}, 'oper': 'CREATE', 'request-id': 'req-53aea99e-60cf-4e04-8170-d8af909b5533', 'type': 'hardware', 'uuid': '1d2d462d-0fb2-4789-ad74-a17b69549fbe'} 03/20/2025 00:46:25.466 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e0a70522-a423-418b-ab13-133cdcba20fa object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.42:8082/alarm/e0a70522-a423-418b-ab13-133cdcba20fa operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "e0a70522-a423-418b-ab13-133cdcba20fa", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.476 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-24q-2p url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-24q-2p"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-24q-2p"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.494 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-338f94a3-1cbe-4c7a-ac60-3c655b1da845', 'type': 'alarm', 'uuid': 'e0a70522-a423-418b-ab13-133cdcba20fa'} 03/20/2025 00:46:25.535 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-779e0e88-d54e-4950-acfe-89c4ac88218d', 'type': 'alarm', 'uuid': 'e0a70522-a423-418b-ab13-133cdcba20fa'} 03/20/2025 00:46:25.549 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-24q-2p'], 'obj_dict': {'display_name': 'juniper-qfx5100-24q-2p', 'fq_name': ['juniper-qfx5100-24q-2p'], 'id_perms': {'created': '2025-03-20T00:46:25.511666', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.511666', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12395689979766612835, 'uuid_mslong': 16391714253145916661}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'e37b1144-2678-44f5-ac06-565c85dba363'}, 'oper': 'CREATE', 'request-id': 'req-dd4f4c3e-e707-4e04-a485-c5d75a4f2b8d', 'type': 'hardware', 'uuid': 'e37b1144-2678-44f5-ac06-565c85dba363'} 03/20/2025 00:46:25.558 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '90'}, 'operation': '>', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-disk-usage-critical', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'id_perms': {'created': '2025-03-20T00:46:25.498962', 'creator': None, 'description': 'Disk usage crosses critical ' 'threshold limit.', 'enable': True, 'last_modified': '2025-03-20T00:46:25.498962', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12524767781199082204, 'uuid_mslong': 17119790729462827169}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-9f6abc70-429e-4e61-9737-2b992d94f305', 'type': 'alarm', 'uuid': 'ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc'} 03/20/2025 00:46:25.596 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Node Failure. NodeStatus UVE not present.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-node-status"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.619 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-24q-aa'], 'obj_dict': {'display_name': 'juniper-qfx5100-24q-aa', 'fq_name': ['juniper-qfx5100-24q-aa'], 'id_perms': {'created': '2025-03-20T00:46:25.606546', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.606546', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11848511362718594519, 'uuid_mslong': 13324234072842652154}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'b8e9304b-5ff1-49fa-a46e-5e4eec0575d7'}, 'oper': 'CREATE', 'request-id': 'req-be5749f2-ac87-49e1-baae-7937034238eb', 'type': 'hardware', 'uuid': 'b8e9304b-5ff1-49fa-a46e-5e4eec0575d7'} 03/20/2025 00:46:25.652 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-node-status', 'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'id_perms': {'created': '2025-03-20T00:46:25.633662', 'creator': None, 'description': 'Node Failure. NodeStatus UVE not ' 'present.', 'enable': True, 'last_modified': '2025-03-20T00:46:25.633662', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12630450553733415716, 'uuid_mslong': 8639492513008992846}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '77e5a4aa-a58c-424e-af48-5fdc106a8324', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-bb2db0d7-ea1d-42be-b733-82fce6899366', 'type': 'alarm', 'uuid': '77e5a4aa-a58c-424e-af48-5fdc106a8324'} 03/20/2025 00:46:25.663 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-48s-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-48s-6q', 'fq_name': ['juniper-qfx5100e-48s-6q'], 'id_perms': {'created': '2025-03-20T00:46:25.649965', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.649965', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9348276551429313447, 'uuid_mslong': 3572147223077994816}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '3192d0f9-2cf6-4140-81bb-bffe860ed3a7'}, 'oper': 'CREATE', 'request-id': 'req-002bc999-0ea0-4b34-8467-01cd4bebb401', 'type': 'hardware', 'uuid': '3192d0f9-2cf6-4140-81bb-bffe860ed3a7'} 03/20/2025 00:46:25.666 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.42:8082/alarm/b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.689 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-96s-8q url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-96s-8q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-96s-8q"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.693 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.42:8082/alarm/b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.706 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "System Info Incomplete.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-partial-sysinfo"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.728 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-4dd992b8-1ebf-4cc8-8331-716b52b65e94', 'type': 'alarm', 'uuid': 'b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d'} 03/20/2025 00:46:25.730 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-c3bd79de-b537-42d9-a75d-33d5f5582041', 'type': 'alarm', 'uuid': 'b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d'} 03/20/2025 00:46:25.740 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-96s-8q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-96s-8q', 'fq_name': ['juniper-qfx5100e-96s-8q'], 'id_perms': {'created': '2025-03-20T00:46:25.725032', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.725032', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10197720082131821837, 'uuid_mslong': 18143362281589132338}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'fbca2bde-1157-4c32-8d85-94628655a50d'}, 'oper': 'CREATE', 'request-id': 'req-cb842097-c373-41fb-a2e5-1ecedc8bd487', 'type': 'hardware', 'uuid': 'fbca2bde-1157-4c32-8d85-94628655a50d'} 03/20/2025 00:46:25.783 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.build_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-partial-sysinfo', 'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'id_perms': {'created': '2025-03-20T00:46:25.776664', 'creator': None, 'description': 'System Info Incomplete.', 'enable': True, 'last_modified': '2025-03-20T00:46:25.776664', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12176106511756922857, 'uuid_mslong': 6223527215563426517}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '565e6907-65a2-4ad5-a8fa-385c54978fe9', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-52e47b5e-3e5a-432b-8064-af14172ac56f', 'type': 'alarm', 'uuid': '565e6907-65a2-4ad5-a8fa-385c54978fe9'} 03/20/2025 00:46:25.785 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-48t-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-48t-6q', 'fq_name': ['juniper-qfx5100e-48t-6q'], 'id_perms': {'created': '2025-03-20T00:46:25.762433', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.762433', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10186917863219314298, 'uuid_mslong': 7409823661785434573}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '66d4fb5c-8901-49cd-8d5f-33d2f144be7a'}, 'oper': 'CREATE', 'request-id': 'req-08ffeab8-15f6-4cf3-ba7e-6dc07ce70ef1', 'type': 'hardware', 'uuid': '66d4fb5c-8901-49cd-8d5f-33d2f144be7a'} 03/20/2025 00:46:25.822 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-24q-2p'], 'obj_dict': {'display_name': 'juniper-qfx5100e-24q-2p', 'fq_name': ['juniper-qfx5100e-24q-2p'], 'id_perms': {'created': '2025-03-20T00:46:25.813595', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.813595', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13556527786684579809, 'uuid_mslong': 15520802374800000599}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'd764f786-f2fe-4657-bc22-7632490bffe1'}, 'oper': 'CREATE', 'request-id': 'req-ddb64975-12a3-4a4d-88c8-92942c0f98dd', 'type': 'hardware', 'uuid': 'd764f786-f2fe-4657-bc22-7632490bffe1'} 03/20/2025 00:46:25.838 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process(es) reporting as non-functional.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-connectivity"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.872 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_status', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_status.state', 'operand2': {'json_value': '"Functional"'}, 'operation': '!=', 'variables': ['NodeStatus.process_status.module_id', 'NodeStatus.process_status.instance_id']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'id_perms': {'created': '2025-03-20T00:46:25.859794', 'creator': None, 'description': 'Process(es) reporting as ' 'non-functional.', 'enable': True, 'last_modified': '2025-03-20T00:46:25.859794', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13296552880922418793, 'uuid_mslong': 11008292417040499669}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '98c54fa0-fd53-43d5-b886-d865a493de69', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-f8096989-8671-4e26-b939-950a841e21d3', 'type': 'alarm', 'uuid': '98c54fa0-fd53-43d5-b886-d865a493de69'} 03/20/2025 00:46:25.876 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8f2b5ec4-29e4-4bfe-afdf-830264fdfbae object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.42:8082/alarm/8f2b5ec4-29e4-4bfe-afdf-830264fdfbae operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "8f2b5ec4-29e4-4bfe-afdf-830264fdfbae", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.878 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8f2b5ec4-29e4-4bfe-afdf-830264fdfbae object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.42:8082/alarm/8f2b5ec4-29e4-4bfe-afdf-830264fdfbae operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "8f2b5ec4-29e4-4bfe-afdf-830264fdfbae", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.882 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5110-48s-4c url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5110-48s-4c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5110-48s-4c"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.903 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-c2b15b90-a5bb-411d-97e1-4ca05f44bf76', 'type': 'alarm', 'uuid': '8f2b5ec4-29e4-4bfe-afdf-830264fdfbae'} 03/20/2025 00:46:25.910 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5110-48s-4c'], 'obj_dict': {'display_name': 'juniper-qfx5110-48s-4c', 'fq_name': ['juniper-qfx5110-48s-4c'], 'id_perms': {'created': '2025-03-20T00:46:25.892729', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.892729', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9770184298837435408, 'uuid_mslong': 18021774889776006473}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'fa1a34c7-5f27-4549-8796-aadaea4de410'}, 'oper': 'CREATE', 'request-id': 'req-01110b22-6443-4c37-b356-0be69127c9fa', 'type': 'hardware', 'uuid': 'fa1a34c7-5f27-4549-8796-aadaea4de410'} 03/20/2025 00:46:25.917 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-0e81ebf1-221b-4bd3-9949-d6a8386df709', 'type': 'alarm', 'uuid': '8f2b5ec4-29e4-4bfe-afdf-830264fdfbae'} 03/20/2025 00:46:25.924 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process Failure.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-status"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:25.943 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5110-32q'], 'obj_dict': {'display_name': 'juniper-qfx5110-32q', 'fq_name': ['juniper-qfx5110-32q'], 'id_perms': {'created': '2025-03-20T00:46:25.926734', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:25.926734', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12966502384275911176, 'uuid_mslong': 14122937154070003843}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'c3fec083-dd82-4083-b3f2-453812057208'}, 'oper': 'CREATE', 'request-id': 'req-427b2558-53de-4b83-806c-2a828f840890', 'type': 'hardware', 'uuid': 'c3fec083-dd82-4083-b3f2-453812057208'} 03/20/2025 00:46:25.968 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_info.process_state', 'operand2': {'json_value': '"PROCESS_STATE_RUNNING"'}, 'operation': '!=', 'variables': ['NodeStatus.process_info.process_name']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-status', 'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'id_perms': {'created': '2025-03-20T00:46:25.950879', 'creator': None, 'description': 'Process Failure.', 'enable': True, 'last_modified': '2025-03-20T00:46:25.950879', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10750334923433855383, 'uuid_mslong': 7675205046695448418}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6a83ce53-3291-4f62-9530-dca7b7c04997', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-849d6347-98c2-4e59-b35a-49820c63b294', 'type': 'alarm', 'uuid': '6a83ce53-3291-4f62-9530-dca7b7c04997'} 03/20/2025 00:46:26.024 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tor agent does not exist we look for non-empty value for connected_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-connectivity"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.030 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-48y-8c'], 'obj_dict': {'display_name': 'juniper-qfx5120-48y-8c', 'fq_name': ['juniper-qfx5120-48y-8c'], 'id_perms': {'created': '2025-03-20T00:46:26.016501', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.016501', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11733055849267822265, 'uuid_mslong': 2876909631849778560}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '27ecd611-514e-4d80-a2d4-3021696d7eb9'}, 'oper': 'CREATE', 'request-id': 'req-42d757c3-8120-4078-a7ed-29331bc4b070', 'type': 'hardware', 'uuid': '27ecd611-514e-4d80-a2d4-3021696d7eb9'} 03/20/2025 00:46:26.043 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-32c url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-32c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-32c"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.050 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.42:8082/alarm/ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.052 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.42:8082/alarm/ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.071 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-32c'], 'obj_dict': {'display_name': 'juniper-qfx5120-32c', 'fq_name': ['juniper-qfx5120-32c'], 'id_perms': {'created': '2025-03-20T00:46:26.056464', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.056464', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12003113714707218603, 'uuid_mslong': 1676180069692162333}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '1742fce4-8197-411d-a693-a0540bbe40ab'}, 'oper': 'CREATE', 'request-id': 'req-cdff6989-c539-4514-bec2-c05213ce7ae2', 'type': 'hardware', 'uuid': '1742fce4-8197-411d-a693-a0540bbe40ab'} 03/20/2025 00:46:26.087 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-31044ca1-691b-4de1-a047-758535821920', 'type': 'alarm', 'uuid': 'ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc'} 03/20/2025 00:46:26.095 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-ad680460-6703-42dc-a081-c1337cf72e27', 'type': 'alarm', 'uuid': 'ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc'} 03/20/2025 00:46:26.106 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.connected_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'id_perms': {'created': '2025-03-20T00:46:26.066484', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tor agent does not exist we look ' 'for non-empty value for ' 'connected_agent_list', 'enable': True, 'last_modified': '2025-03-20T00:46:26.066484', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10941451209867463852, 'uuid_mslong': 1644894336952977983}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '16d3d6af-3722-4a3f-97d7-d7e7b36b0cac', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-a2c2bdb3-9914-4b33-a751-4a02d9dfae90', 'type': 'alarm', 'uuid': '16d3d6af-3722-4a3f-97d7-d7e7b36b0cac'} 03/20/2025 00:46:26.107 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-48t-6c'], 'obj_dict': {'display_name': 'juniper-qfx5120-48t-6c', 'fq_name': ['juniper-qfx5120-48t-6c'], 'id_perms': {'created': '2025-03-20T00:46:26.095434', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.095434', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10192730148942142881, 'uuid_mslong': 15166424785455959885}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'd279f6fc-b9c8-4f4d-8d73-da112b1c5da1'}, 'oper': 'CREATE', 'request-id': 'req-4e4e52cf-e37d-4024-a1eb-96aa647136ce', 'type': 'hardware', 'uuid': 'd279f6fc-b9c8-4f4d-8d73-da112b1c5da1'} 03/20/2025 00:46:26.143 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5220-32cd'], 'obj_dict': {'display_name': 'juniper-qfx5220-32cd', 'fq_name': ['juniper-qfx5220-32cd'], 'id_perms': {'created': '2025-03-20T00:46:26.133025', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.133025', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12444095518225606243, 'uuid_mslong': 2043993190962120800}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '1c5db8fa-469d-4860-acb2-4ef132de2663'}, 'oper': 'CREATE', 'request-id': 'req-cfbc2c57-7716-40b2-9edc-ee1e263a371d', 'type': 'hardware', 'uuid': '1c5db8fa-469d-4860-acb2-4ef132de2663'} 03/20/2025 00:46:26.152 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tsn agent does not exist we look for non-empty value for tsn_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-tsn-connectivity"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.153 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5220-128c url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5220-128c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5220-128c"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.168 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5220-128c'], 'obj_dict': {'display_name': 'juniper-qfx5220-128c', 'fq_name': ['juniper-qfx5220-128c'], 'id_perms': {'created': '2025-03-20T00:46:26.161803', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.161803', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12838378059390189119, 'uuid_mslong': 3982939633977673732}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '37463e7e-9d10-4804-b22b-14d30a1efe3f'}, 'oper': 'CREATE', 'request-id': 'req-26520ac8-582c-49d1-9bdd-2728adc02478', 'type': 'hardware', 'uuid': '37463e7e-9d10-4804-b22b-14d30a1efe3f'} 03/20/2025 00:46:26.182 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'id_perms': {'created': '2025-03-20T00:46:26.159192', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.159192', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12936890627982115736, 'uuid_mslong': 13217865575819659668}}, 'parent_type': 'security-group', 'parent_uuid': '4104c054-7c2d-4648-b55d-51e37ee22074', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b76f4ab5-bf98-4994-b389-117bcaf44398'}, 'oper': 'CREATE', 'request-id': 'req-fc6692f6-4503-4165-8a30-4314227076a3', 'type': 'access_control_list', 'uuid': 'b76f4ab5-bf98-4994-b389-117bcaf44398'} 03/20/2025 00:46:26.193 7fabc231cd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:egress-access-control-list url = http://10.0.0.42:8082/access-control-lists operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/usr/bin/contrail-schema remote_ip = 10.0.0.47 body = {"access-control-list": {"uuid": null, "fq_name": ["default-domain", "default-project", "__no_rule__", "egress-access-control-list"], "parent_type": "security-group", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "egress-access-control-list"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.217 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '!='}]}, {'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-tsn-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'id_perms': {'created': '2025-03-20T00:46:26.186927', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tsn agent does not exist we look ' 'for non-empty value for ' 'tsn_agent_list', 'enable': True, 'last_modified': '2025-03-20T00:46:26.186927', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13268262831514720849, 'uuid_mslong': 16153172239660042775}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e02b9891-9ca3-4a17-b822-56bf3af41a51', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-68b9ff62-c62c-4ccf-abdc-f6d79c5dfbee', 'type': 'alarm', 'uuid': 'e02b9891-9ca3-4a17-b822-56bf3af41a51'} 03/20/2025 00:46:26.247 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 77e5a4aa-a58c-424e-af48-5fdc106a8324 object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.42:8082/alarm/77e5a4aa-a58c-424e-af48-5fdc106a8324 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "77e5a4aa-a58c-424e-af48-5fdc106a8324", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.249 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'id_perms': {'created': '2025-03-20T00:46:26.236386', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.236386', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10779278293434348962, 'uuid_mslong': 15812634123488477894}}, 'parent_type': 'security-group', 'parent_uuid': '4104c054-7c2d-4648-b55d-51e37ee22074', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'db71c2f4-d5c0-42c6-9597-b07f2f3bb5a2'}, 'oper': 'CREATE', 'request-id': 'req-6a37fd27-aa9f-4842-a0f2-c4d020195026', 'type': 'access_control_list', 'uuid': 'db71c2f4-d5c0-42c6-9597-b07f2f3bb5a2'} 03/20/2025 00:46:26.267 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5200-32c-32q'], 'obj_dict': {'display_name': 'juniper-qfx5200-32c-32q', 'fq_name': ['juniper-qfx5200-32c-32q'], 'id_perms': {'created': '2025-03-20T00:46:26.241471', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.241471', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12426527080680176049, 'uuid_mslong': 13079441494740387963}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'b58382bd-da81-487b-ac73-e48a93b6b9b1'}, 'oper': 'CREATE', 'request-id': 'req-7c2aa052-1d77-4b9a-a6d4-df101c096b50', 'type': 'hardware', 'uuid': 'b58382bd-da81-487b-ac73-e48a93b6b9b1'} 03/20/2025 00:46:26.274 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 77e5a4aa-a58c-424e-af48-5fdc106a8324 object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.42:8082/alarm/77e5a4aa-a58c-424e-af48-5fdc106a8324 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "77e5a4aa-a58c-424e-af48-5fdc106a8324", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.295 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Storage Cluster warning/errors.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-storage-cluster-state"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.320 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5200-48y'], 'obj_dict': {'display_name': 'juniper-qfx5200-48y', 'fq_name': ['juniper-qfx5200-48y'], 'id_perms': {'created': '2025-03-20T00:46:26.308761', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.308761', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11653004593863590462, 'uuid_mslong': 15686007793661855702}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'd9afe4fa-f539-47d6-a1b7-c9f0173c023e'}, 'oper': 'CREATE', 'request-id': 'req-6d5a1771-7669-4e39-9a43-bd6b63967acf', 'type': 'hardware', 'uuid': 'd9afe4fa-f539-47d6-a1b7-c9f0173c023e'} 03/20/2025 00:46:26.321 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-def493b3-8ef6-4c89-a7c6-702e894c3a9e', 'type': 'alarm', 'uuid': '77e5a4aa-a58c-424e-af48-5fdc106a8324'} 03/20/2025 00:46:26.323 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-49a8654e-5744-4481-bc97-169b36da0892', 'type': 'alarm', 'uuid': '77e5a4aa-a58c-424e-af48-5fdc106a8324'} 03/20/2025 00:46:26.343 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5210-64c url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5210-64c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5210-64c"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.364 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'StorageCluster.info_stats.status', 'operand2': {'json_value': '0'}, 'operation': '!=', 'variables': ['StorageCluster.info_stats.health_summary']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-storage-cluster-state', 'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'id_perms': {'created': '2025-03-20T00:46:26.344694', 'creator': None, 'description': 'Storage Cluster warning/errors.', 'enable': True, 'last_modified': '2025-03-20T00:46:26.344694', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11488773423118694053, 'uuid_mslong': 13384158510124580939}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b9be1540-ad7f-404b-9f70-528ee5f036a5', 'uve_keys': {'uve_key': ['storage-cluster']}}, 'oper': 'CREATE', 'request-id': 'req-e33d2f27-76fd-495d-9c86-4ac8e0a6d2ad', 'type': 'alarm', 'uuid': 'b9be1540-ad7f-404b-9f70-528ee5f036a5'} 03/20/2025 00:46:26.387 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5210-64c'], 'obj_dict': {'display_name': 'juniper-qfx5210-64c', 'fq_name': ['juniper-qfx5210-64c'], 'id_perms': {'created': '2025-03-20T00:46:26.372626', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.372626', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12388043902520801363, 'uuid_mslong': 17890683641129420934}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'f84879fb-9269-4886-abeb-2c4b6fb23853'}, 'oper': 'CREATE', 'request-id': 'req-f7785021-ff3e-4077-a7a4-85b624f7eff3', 'type': 'hardware', 'uuid': 'f84879fb-9269-4886-abeb-2c4b6fb23853'} 03/20/2025 00:46:26.395 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000000'], 'obj_dict': {'display_name': 'target:64512:8000000', 'fq_name': ['target:64512:8000000'], 'id_perms': {'created': '2025-03-20T00:46:26.369966', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.369966', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10801097737864569744, 'uuid_mslong': 14705542222613269643}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'cc1494bc-f85f-4c8b-95e5-352a79b16390'}, 'oper': 'CREATE', 'request-id': 'req-ce28e677-4087-4bdd-a35a-4b779cca251f', 'type': 'route_target', 'uuid': 'cc1494bc-f85f-4c8b-95e5-352a79b16390'} 03/20/2025 00:46:26.411 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Vrouter interface(s) down.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-interface"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.420 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-72q'], 'obj_dict': {'display_name': 'juniper-qfx10002-72q', 'fq_name': ['juniper-qfx10002-72q'], 'id_perms': {'created': '2025-03-20T00:46:26.405494', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.405494', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12592479086393806528, 'uuid_mslong': 8224015361054360051}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '72219265-ef00-41f3-aec1-7902e209cec0'}, 'oper': 'CREATE', 'request-id': 'req-8cefd7b6-8083-4ed4-82d2-09b87a431e27', 'type': 'hardware', 'uuid': '72219265-ef00-41f3-aec1-7902e209cec0'} 03/20/2025 00:46:26.450 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'oper': 'UPDATE', 'request-id': 'req-d4407b90-ce0b-4e8f-b2f7-a4217feead70', 'type': 'routing_instance', 'uuid': 'f043d151-fc6e-4ee6-9b95-bc5bacade44c'} 03/20/2025 00:46:26.453 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.down_interface_count', 'operand2': {'json_value': '1'}, 'operation': '>=', 'variables': ['VrouterAgent.error_intf_list', 'VrouterAgent.no_config_intf_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-interface', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'id_perms': {'created': '2025-03-20T00:46:26.441161', 'creator': None, 'description': 'Vrouter interface(s) down.', 'enable': True, 'last_modified': '2025-03-20T00:46:26.441161', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9252238298927087584, 'uuid_mslong': 17697449682785944948}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f599f8b8-acce-4574-8066-8db660d03fe0', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-dc33bde2-2dd6-473c-82da-90787be5805d', 'type': 'alarm', 'uuid': 'f599f8b8-acce-4574-8066-8db660d03fe0'} 03/20/2025 00:46:26.473 7fabc231cd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000001 url = http://10.0.0.42:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/usr/bin/contrail-schema remote_ip = 10.0.0.47 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000001"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000001"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.475 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 565e6907-65a2-4ad5-a8fa-385c54978fe9 object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.42:8082/alarm/565e6907-65a2-4ad5-a8fa-385c54978fe9 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "565e6907-65a2-4ad5-a8fa-385c54978fe9", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.485 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 565e6907-65a2-4ad5-a8fa-385c54978fe9 object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.42:8082/alarm/565e6907-65a2-4ad5-a8fa-385c54978fe9 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "565e6907-65a2-4ad5-a8fa-385c54978fe9", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.497 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-36q'], 'obj_dict': {'display_name': 'juniper-qfx10002-36q', 'fq_name': ['juniper-qfx10002-36q'], 'id_perms': {'created': '2025-03-20T00:46:26.491580', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.491580', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10452099603235371328, 'uuid_mslong': 9028886061759810650}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '7d4d0c09-3cab-4c5a-910d-513627d87940'}, 'oper': 'CREATE', 'request-id': 'req-042b29d8-f995-44bd-bbe6-7eeae58dd73d', 'type': 'hardware', 'uuid': '7d4d0c09-3cab-4c5a-910d-513627d87940'} 03/20/2025 00:46:26.509 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10002-60c url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10002-60c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10002-60c"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.518 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000001'], 'obj_dict': {'display_name': 'target:64512:8000001', 'fq_name': ['target:64512:8000001'], 'id_perms': {'created': '2025-03-20T00:46:26.489979', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.489979', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13056074262082485525, 'uuid_mslong': 15850766466763342614}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'dbf93c1e-dd1a-4316-b530-7e5e088bfd15'}, 'oper': 'CREATE', 'request-id': 'req-f70a1863-e761-4bc7-a506-9e2288ea643b', 'type': 'route_target', 'uuid': 'dbf93c1e-dd1a-4316-b530-7e5e088bfd15'} 03/20/2025 00:46:26.529 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP peer mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-connectivity"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.537 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-ecc796f9-091a-4eb6-8b2c-0c89ec295dd7', 'type': 'alarm', 'uuid': '565e6907-65a2-4ad5-a8fa-385c54978fe9'} 03/20/2025 00:46:26.555 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-c58fe0fe-e6fe-4e35-89d8-9a4eb61c4ee7', 'type': 'alarm', 'uuid': '565e6907-65a2-4ad5-a8fa-385c54978fe9'} 03/20/2025 00:46:26.559 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-60c'], 'obj_dict': {'display_name': 'juniper-qfx10002-60c', 'fq_name': ['juniper-qfx10002-60c'], 'id_perms': {'created': '2025-03-20T00:46:26.523620', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.523620', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10786785027095183122, 'uuid_mslong': 6546923030960489789}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '5adb57cf-4039-453d-95b2-5bd4d082bf12'}, 'oper': 'CREATE', 'request-id': 'req-dbebbfa5-f056-4728-995a-4cc5d417940e', 'type': 'hardware', 'uuid': '5adb57cf-4039-453d-95b2-5bd4d082bf12'} 03/20/2025 00:46:26.588 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'oper': 'UPDATE', 'request-id': 'req-caf82093-b5d1-4326-bc39-6dbb607bc51c', 'type': 'routing_instance', 'uuid': '557b482a-6c12-443b-b5a1-f18f713a3a87'} 03/20/2025 00:46:26.590 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_xmpp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'id_perms': {'created': '2025-03-20T00:46:26.582510', 'creator': None, 'description': 'XMPP peer mismatch.', 'enable': True, 'last_modified': '2025-03-20T00:46:26.582510', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9239210771142807490, 'uuid_mslong': 626482787392702397}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '08b1b6c6-a070-47bd-8038-453eb2ee0fc2', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-8934bb55-341b-4df6-93b8-566404948962', 'type': 'alarm', 'uuid': '08b1b6c6-a070-47bd-8038-453eb2ee0fc2'} 03/20/2025 00:46:26.632 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10016'], 'obj_dict': {'display_name': 'juniper-qfx10016', 'fq_name': ['juniper-qfx10016'], 'id_perms': {'created': '2025-03-20T00:46:26.618663', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.618663', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12102169288050846396, 'uuid_mslong': 18119811670465267308}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'fb7680b6-1f0f-466c-a7f3-8ad8f1e9aabc'}, 'oper': 'CREATE', 'request-id': 'req-560a997e-17ca-41e8-8470-9a75c74b1fea', 'type': 'hardware', 'uuid': 'fb7680b6-1f0f-466c-a7f3-8ad8f1e9aabc'} 03/20/2025 00:46:26.648 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP connection closed towards peer, alarm has close reason", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-close-reason"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.658 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000002'], 'obj_dict': {'display_name': 'target:64512:8000002', 'fq_name': ['target:64512:8000002'], 'id_perms': {'created': '2025-03-20T00:46:26.646677', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.646677', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13138917109946718971, 'uuid_mslong': 4459274419345507151}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '3de28675-4913-434f-b656-cf7f9fad1afb'}, 'oper': 'CREATE', 'request-id': 'req-d23e8652-29bb-4b2c-b30c-13eda5c1ca46', 'type': 'route_target', 'uuid': '3de28675-4913-434f-b656-cf7f9fad1afb'} 03/20/2025 00:46:26.671 7fabc231cd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6199da6c-d44f-4b97-a989-a63782b4267b object_type = routing_instance identifier_name = default-domain:default-project:default-virtual-network:default-virtual-network url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/usr/bin/contrail-schema remote_ip = 10.0.0.47 body = {"type": "routing-instance", "uuid": "6199da6c-d44f-4b97-a989-a63782b4267b", "ref-type": "route-target", "ref-uuid": "3de28675-4913-434f-b656-cf7f9fad1afb", "ref-fq-name": ["target:64512:8000002"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.694 7fabc220ec18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:26.700 7fabc215dac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 98c54fa0-fd53-43d5-b886-d865a493de69 object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.42:8082/alarm/98c54fa0-fd53-43d5-b886-d865a493de69 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "98c54fa0-fd53-43d5-b886-d865a493de69", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.700 7fabc215dac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 98c54fa0-fd53-43d5-b886-d865a493de69 object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.42:8082/alarm/98c54fa0-fd53-43d5-b886-d865a493de69 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "98c54fa0-fd53-43d5-b886-d865a493de69", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.717 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10008'], 'obj_dict': {'display_name': 'juniper-qfx10008', 'fq_name': ['juniper-qfx10008'], 'id_perms': {'created': '2025-03-20T00:46:26.699795', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.699795', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12706882900878265947, 'uuid_mslong': 10602736596731709262}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '93247cc2-4f3a-474e-b057-eaaca5558e5b'}, 'oper': 'CREATE', 'request-id': 'req-26366b50-4247-4071-950c-36787f56a6cc', 'type': 'hardware', 'uuid': '93247cc2-4f3a-474e-b057-eaaca5558e5b'} 03/20/2025 00:46:26.732 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'oper': 'UPDATE', 'request-id': 'req-0e8323af-c4e2-4c4c-be13-4bdd4f12230a', 'type': 'routing_instance', 'uuid': '6199da6c-d44f-4b97-a989-a63782b4267b'} 03/20/2025 00:46:26.737 7fabc20a5ac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 98c54fa0-fd53-43d5-b886-d865a493de69 object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.42:8082/alarm/98c54fa0-fd53-43d5-b886-d865a493de69 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "98c54fa0-fd53-43d5-b886-d865a493de69", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.740 7fabc20a5ac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 98c54fa0-fd53-43d5-b886-d865a493de69 object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.42:8082/alarm/98c54fa0-fd53-43d5-b886-d865a493de69 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "98c54fa0-fd53-43d5-b886-d865a493de69", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.747 7fabc20b52e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-vqfx-10000 url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-vqfx-10000"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-vqfx-10000"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.747 7fabc20b52e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-vqfx-10000 url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-vqfx-10000"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-vqfx-10000"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.747 7fabc220ec18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:26.749 7fabc220ec18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:26.749 7fabc220ec18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:26.751 7fabc220ec18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:26.752 7fabc220ec18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:26.752 7fabc220ec18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:26.752 7fabc220ec18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:26.752 7fabc220ec18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:26.752 7fabc220ec18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:26.752 7fabc220ec18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:26.752 7fabc220ec18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:26.753 7fabc220ec18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:46:26.753 7fabc220ec18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:26.757 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'XmppPeerInfoData.close_reason', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'XmppPeerInfoData.state_info.state', 'operand2': {'json_value': '"Established"'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-close-reason', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'id_perms': {'created': '2025-03-20T00:46:26.697176', 'creator': None, 'description': 'XMPP connection closed towards ' 'peer, ' 'alarm has close reason', 'enable': True, 'last_modified': '2025-03-20T00:46:26.697176', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11023489542079003220, 'uuid_mslong': 5491667519283088611}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4c365283-3f6b-4ce3-98fb-4d5564da3a54', 'uve_keys': {'uve_key': ['xmpp-peer']}}, 'oper': 'CREATE', 'request-id': 'req-ecfb040d-ba8b-4b5a-b5e5-bbd2106896b1', 'type': 'alarm', 'uuid': '4c365283-3f6b-4ce3-98fb-4d5564da3a54'} 03/20/2025 00:46:26.759 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000003'], 'obj_dict': {'display_name': 'target:64512:8000003', 'fq_name': ['target:64512:8000003'], 'id_perms': {'created': '2025-03-20T00:46:26.752118', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.752118', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12674842543926702601, 'uuid_mslong': 9443691281981393978}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '830ebb2f-a6f4-4c3a-afe6-1623b6c27209'}, 'oper': 'CREATE', 'request-id': 'req-c2c7daec-aa28-4f93-badb-af2d4775c66f', 'type': 'route_target', 'uuid': '830ebb2f-a6f4-4c3a-afe6-1623b6c27209'} 03/20/2025 00:46:26.789 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vqfx-10000'], 'obj_dict': {'display_name': 'juniper-vqfx-10000', 'fq_name': ['juniper-vqfx-10000'], 'id_perms': {'created': '2025-03-20T00:46:26.775591', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.775591', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12211566271500961358, 'uuid_mslong': 7525086688179798053}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '686e7a79-28fa-4025-a978-32d303f4c64e'}, 'oper': 'CREATE', 'request-id': 'req-95970198-b880-42f0-8b66-9fa53516a668', 'type': 'hardware', 'uuid': '686e7a79-28fa-4025-a978-32d303f4c64e'} 03/20/2025 00:46:26.796 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "A core file has been generated on the node.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-core-files"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.797 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-dc3189c6-731f-4c25-b349-740aea070752', 'type': 'routing_instance', 'uuid': '1484d1b9-162e-46af-9c90-c6a8a15d25d8'} 03/20/2025 00:46:26.801 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-cb67c060-0860-44b9-9b35-c69c5de7824f', 'type': 'alarm', 'uuid': '98c54fa0-fd53-43d5-b886-d865a493de69'} 03/20/2025 00:46:26.806 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-8cc2f8b7-7912-4f51-b9ea-65c092f0478a', 'type': 'alarm', 'uuid': '98c54fa0-fd53-43d5-b886-d865a493de69'} 03/20/2025 00:46:26.849 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-core-files', 'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'id_perms': {'created': '2025-03-20T00:46:26.835160', 'creator': None, 'description': 'A core file has been generated on ' 'the node.', 'enable': True, 'last_modified': '2025-03-20T00:46:26.835160', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11476677573480364309, 'uuid_mslong': 14581665837631950689}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ca5c7bd2-8580-4f61-9f45-597270fd3915', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-0cb7930f-4188-440d-979b-45aa4b1ff091', 'type': 'alarm', 'uuid': 'ca5c7bd2-8580-4f61-9f45-597270fd3915'} 03/20/2025 00:46:26.868 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx80'], 'obj_dict': {'display_name': 'juniper-mx80', 'fq_name': ['juniper-mx80'], 'id_perms': {'created': '2025-03-20T00:46:26.850253', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.850253', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11632251448496617156, 'uuid_mslong': 11584840040728250370}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'a0c59ea3-4f54-4802-a16e-0f0fe5a9f6c4'}, 'oper': 'CREATE', 'request-id': 'req-3464e162-f079-4d62-95e1-c90cf8f0c329', 'type': 'hardware', 'uuid': 'a0c59ea3-4f54-4802-a16e-0f0fe5a9f6c4'} 03/20/2025 00:46:26.902 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Pending compaction tasks in cassandra crossed the configured threshold.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-pending-cassandra-compaction-tasks"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.908 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx80-48t'], 'obj_dict': {'display_name': 'juniper-mx80-48t', 'fq_name': ['juniper-mx80-48t'], 'id_perms': {'created': '2025-03-20T00:46:26.898002', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.898002', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11599959002801627597, 'uuid_mslong': 9444786876976678993}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '83129f9f-bd77-4851-a0fb-5540fb15e1cd'}, 'oper': 'CREATE', 'request-id': 'req-9684c817-1321-41a5-af14-72b794ff1e31', 'type': 'hardware', 'uuid': '83129f9f-bd77-4851-a0fb-5540fb15e1cd'} 03/20/2025 00:46:26.923 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx204 url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx204"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx204"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.941 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx204'], 'obj_dict': {'display_name': 'juniper-mx204', 'fq_name': ['juniper-mx204'], 'id_perms': {'created': '2025-03-20T00:46:26.935623', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.935623', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11116995998876198401, 'uuid_mslong': 8932695853602390525}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '7bf74f8d-2893-41fd-9a47-80f5ea746601'}, 'oper': 'CREATE', 'request-id': 'req-614256e5-d2dc-44a3-9c24-84248a1b2d66', 'type': 'hardware', 'uuid': '7bf74f8d-2893-41fd-9a47-80f5ea746601'} 03/20/2025 00:46:26.949 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks', 'operand2': {'json_value': '300'}, 'operation': '>='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-pending-cassandra-compaction-tasks', 'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'id_perms': {'created': '2025-03-20T00:46:26.938794', 'creator': None, 'description': 'Pending compaction tasks in ' 'cassandra crossed the configured ' 'threshold.', 'enable': True, 'last_modified': '2025-03-20T00:46:26.938794', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13443307454615018867, 'uuid_mslong': 11512008353287589708}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9fc2de9a-a509-4f4c-ba90-38e77eb05d73', 'uve_keys': {'uve_key': ['database-nodeconfig-database-node']}}, 'oper': 'CREATE', 'request-id': 'req-74213ba3-5c0b-4ee6-b65c-8ac9c371b2b9', 'type': 'alarm', 'uuid': '9fc2de9a-a509-4f4c-ba90-38e77eb05d73'} 03/20/2025 00:46:26.963 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6a83ce53-3291-4f62-9530-dca7b7c04997 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.42:8082/alarm/6a83ce53-3291-4f62-9530-dca7b7c04997 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "6a83ce53-3291-4f62-9530-dca7b7c04997", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.967 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'deny'}, 'direction': '<>', 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000002'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}], 'dynamic': False}, 'display_name': 'ip-fabric', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'id_perms': {'created': '2025-03-20T00:46:26.953794', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:26.953794', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9536263973934411752, 'uuid_mslong': 16105903349646118644}}, 'parent_type': 'virtual-network', 'parent_uuid': '25e81aa2-d36c-4b63-8506-67606ce5b850', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'df83a9c3-866e-4ef4-8457-9d8f1ab72fe8'}, 'oper': 'CREATE', 'request-id': 'req-487213ff-96e3-4c90-ba85-fdbbdd87042e', 'type': 'access_control_list', 'uuid': 'df83a9c3-866e-4ef4-8457-9d8f1ab72fe8'} 03/20/2025 00:46:26.971 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6a83ce53-3291-4f62-9530-dca7b7c04997 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.42:8082/alarm/6a83ce53-3291-4f62-9530-dca7b7c04997 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "6a83ce53-3291-4f62-9530-dca7b7c04997", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:26.991 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-3996b176-04fa-4eb0-878c-5b47bc6378c2', 'type': 'alarm', 'uuid': '6a83ce53-3291-4f62-9530-dca7b7c04997'} 03/20/2025 00:46:26.996 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-eb1e3383-157a-4c44-a3f1-48d447ce99d1', 'type': 'alarm', 'uuid': '6a83ce53-3291-4f62-9530-dca7b7c04997'} 03/20/2025 00:46:26.996 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-b531abd6-af4a-49c0-827d-352bd57bb032', 'type': 'access_control_list', 'uuid': 'b76f4ab5-bf98-4994-b389-117bcaf44398'} 03/20/2025 00:46:27.000 7fabc231cd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = db71c2f4-d5c0-42c6-9597-b07f2f3bb5a2 object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:egress-access-control-list url = http://10.0.0.42:8082/access-control-list/db71c2f4-d5c0-42c6-9597-b07f2f3bb5a2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/usr/bin/contrail-schema remote_ip = 10.0.0.47 body = {"access-control-list": {"uuid": "db71c2f4-d5c0-42c6-9597-b07f2f3bb5a2", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "access_control_list_hash": -782339169199063927}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.005 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "There is a mismatch between installed and running package version.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-package-version-mismatch"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.018 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx240'], 'obj_dict': {'display_name': 'juniper-mx240', 'fq_name': ['juniper-mx240'], 'id_perms': {'created': '2025-03-20T00:46:27.006760', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.006760', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9689496117180950844, 'uuid_mslong': 3399915653882204015}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '2f2eed46-0ff0-4f6f-8678-0161a518e93c'}, 'oper': 'CREATE', 'request-id': 'req-e86e5a59-c080-4a06-81af-9bbea830e28a', 'type': 'hardware', 'uuid': '2f2eed46-0ff0-4f6f-8678-0161a518e93c'} 03/20/2025 00:46:27.020 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-3bf3fcb6-f57e-4779-8401-15c697d196b6', 'type': 'access_control_list', 'uuid': 'db71c2f4-d5c0-42c6-9597-b07f2f3bb5a2'} 03/20/2025 00:46:27.043 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.running_package_version', 'operand2': {'uve_attribute': 'NodeStatus.installed_package_version'}, 'operation': '!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-package-version-mismatch', 'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'id_perms': {'created': '2025-03-20T00:46:27.033961', 'creator': None, 'description': 'There is a mismatch between ' 'installed and running package ' 'version.', 'enable': True, 'last_modified': '2025-03-20T00:46:27.033961', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9631803283908512872, 'uuid_mslong': 10046048750419396114}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8b6abc1c-bd01-4612-85ab-0a0e23cecc68', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-7a583630-3e53-40d1-ac43-9dcd92b9c1bd', 'type': 'alarm', 'uuid': '8b6abc1c-bd01-4612-85ab-0a0e23cecc68'} 03/20/2025 00:46:27.089 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx480'], 'obj_dict': {'display_name': 'juniper-mx480', 'fq_name': ['juniper-mx480'], 'id_perms': {'created': '2025-03-20T00:46:27.076889', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.076889', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10154128127038575638, 'uuid_mslong': 1628759715211135999}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '169a8454-d9a0-4bff-8cea-b5bb8fefd416'}, 'oper': 'CREATE', 'request-id': 'req-810233db-dd7b-4173-975b-44bdfa0934a7', 'type': 'hardware', 'uuid': '169a8454-d9a0-4bff-8cea-b5bb8fefd416'} 03/20/2025 00:46:27.101 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded configured watermark for resource.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-limit-exceeded"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.104 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx960 url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx960"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx960"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.126 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx960'], 'obj_dict': {'display_name': 'juniper-mx960', 'fq_name': ['juniper-mx960'], 'id_perms': {'created': '2025-03-20T00:46:27.111618', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.111618', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11621521032349833488, 'uuid_mslong': 17381840072184973960}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'f138b373-e53c-4a88-a147-efce32f15910'}, 'oper': 'CREATE', 'request-id': 'req-9eb7ad46-c8eb-4f7c-a3e2-f26bec23646c', 'type': 'hardware', 'uuid': 'f138b373-e53c-4a88-a147-efce32f15910'} 03/20/2025 00:46:27.144 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 16d3d6af-3722-4a3f-97d7-d7e7b36b0cac object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.42:8082/alarm/16d3d6af-3722-4a3f-97d7-d7e7b36b0cac operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "16d3d6af-3722-4a3f-97d7-d7e7b36b0cac", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.145 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 16d3d6af-3722-4a3f-97d7-d7e7b36b0cac object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.42:8082/alarm/16d3d6af-3722-4a3f-97d7-d7e7b36b0cac operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "16d3d6af-3722-4a3f-97d7-d7e7b36b0cac", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.150 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'id_perms': {'created': '2025-03-20T00:46:27.135343', 'creator': None, 'description': 'Agent resource usage exceeded ' 'configured watermark for resource.', 'enable': True, 'last_modified': '2025-03-20T00:46:27.135343', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10200201303875168738, 'uuid_mslong': 14732427202002505067}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cc74187c-06a9-4d6b-8d8e-650afaf4a9e2', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-8f5db54c-1eeb-49b1-abba-378e8c8588e1', 'type': 'alarm', 'uuid': 'cc74187c-06a9-4d6b-8d8e-650afaf4a9e2'} 03/20/2025 00:46:27.179 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-8f2ba858-bcb7-469a-8011-42f3242ff40b', 'type': 'alarm', 'uuid': '16d3d6af-3722-4a3f-97d7-d7e7b36b0cac'} 03/20/2025 00:46:27.181 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-b29eea95-f862-4bff-af29-6b42eb668560', 'type': 'alarm', 'uuid': '16d3d6af-3722-4a3f-97d7-d7e7b36b0cac'} 03/20/2025 00:46:27.201 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded table size for resource in vrouter.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-table-limit-exceeded"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.240 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2008'], 'obj_dict': {'display_name': 'juniper-mx2008', 'fq_name': ['juniper-mx2008'], 'id_perms': {'created': '2025-03-20T00:46:27.231001', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.231001', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10599589962452808288, 'uuid_mslong': 1297816256201183141}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '1202c502-4699-4fa5-9319-4ee96ccbb260'}, 'oper': 'CREATE', 'request-id': 'req-2e9a1f79-5b08-4711-b2c6-a919048e87d2', 'type': 'hardware', 'uuid': '1202c502-4699-4fa5-9319-4ee96ccbb260'} 03/20/2025 00:46:27.257 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_table_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-table-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'id_perms': {'created': '2025-03-20T00:46:27.248718', 'creator': None, 'description': 'Agent resource usage exceeded table ' 'size for resource in vrouter.', 'enable': True, 'last_modified': '2025-03-20T00:46:27.248718', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9715405693852124315, 'uuid_mslong': 3214165757847686503}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2c9b02ba-35bc-4d67-86d4-0e010edd049b', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-53c7367d-8684-46d3-89a6-6c69d931330e', 'type': 'alarm', 'uuid': '2c9b02ba-35bc-4d67-86d4-0e010edd049b'} 03/20/2025 00:46:27.266 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2010'], 'obj_dict': {'display_name': 'juniper-mx2010', 'fq_name': ['juniper-mx2010'], 'id_perms': {'created': '2025-03-20T00:46:27.259492', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.259492', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13743638328215894751, 'uuid_mslong': 16284962578798887353}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'e1ffcf2f-19d6-41b9-bebb-363e1ac07adf'}, 'oper': 'CREATE', 'request-id': 'req-0c488888-a125-4c86-8fea-afe9d4801ebc', 'type': 'hardware', 'uuid': 'e1ffcf2f-19d6-41b9-bebb-363e1ac07adf'} 03/20/2025 00:46:27.310 7fabc227bd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.42:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "On l3 multihomed compute one or more physical interfaces are Inactive.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-l3mh-physical-interface-link-down"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.329 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e02b9891-9ca3-4a17-b822-56bf3af41a51 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.42:8082/alarm/e02b9891-9ca3-4a17-b822-56bf3af41a51 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "e02b9891-9ca3-4a17-b822-56bf3af41a51", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.331 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e02b9891-9ca3-4a17-b822-56bf3af41a51 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.42:8082/alarm/e02b9891-9ca3-4a17-b822-56bf3af41a51 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "e02b9891-9ca3-4a17-b822-56bf3af41a51", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.339 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx2020 url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx2020"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx2020"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.352 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-f6f4ebe9-156c-42ef-ab9b-d9281db7bb4d', 'type': 'alarm', 'uuid': 'e02b9891-9ca3-4a17-b822-56bf3af41a51'} 03/20/2025 00:46:27.368 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-c27ae76a-5c6d-4ce4-b594-8f08959712e1', 'type': 'alarm', 'uuid': 'e02b9891-9ca3-4a17-b822-56bf3af41a51'} 03/20/2025 00:46:27.373 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.l3mh_phy_interface_down', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_l3mh_intf_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-l3mh-physical-interface-link-down', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'id_perms': {'created': '2025-03-20T00:46:27.358183', 'creator': None, 'description': 'On l3 multihomed compute one or ' 'more physical interfaces are ' 'Inactive.', 'enable': True, 'last_modified': '2025-03-20T00:46:27.358183', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12692556086393229685, 'uuid_mslong': 13597963176848935188}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bcb5ab76-d8ec-4914-b025-04833530d175', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-74166df0-4169-4729-9449-7caed7f22abc', 'type': 'alarm', 'uuid': 'bcb5ab76-d8ec-4914-b025-04833530d175'} 03/20/2025 00:46:27.387 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2020'], 'obj_dict': {'display_name': 'juniper-mx2020', 'fq_name': ['juniper-mx2020'], 'id_perms': {'created': '2025-03-20T00:46:27.363961', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.363961', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9797858356381595433, 'uuid_mslong': 9129858453613855679}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '7eb3c5e4-3940-43bf-87f8-fc438bb7b729'}, 'oper': 'CREATE', 'request-id': 'req-159f1e75-65ba-4cec-a170-ab7be809a071', 'type': 'hardware', 'uuid': '7eb3c5e4-3940-43bf-87f8-fc438bb7b729'} 03/20/2025 00:46:27.431 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx10003'], 'obj_dict': {'display_name': 'juniper-mx10003', 'fq_name': ['juniper-mx10003'], 'id_perms': {'created': '2025-03-20T00:46:27.412063', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.412063', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13474997852796268804, 'uuid_mslong': 5555645482801449666}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '4d199e21-ac62-4ac2-bb00-cf274d12b104'}, 'oper': 'CREATE', 'request-id': 'req-10a7def6-478c-4c0d-9fef-b96e0b6aade7', 'type': 'hardware', 'uuid': '4d199e21-ac62-4ac2-bb00-cf274d12b104'} 03/20/2025 00:46:27.481 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-jnp10008'], 'obj_dict': {'display_name': 'juniper-jnp10008', 'fq_name': ['juniper-jnp10008'], 'id_perms': {'created': '2025-03-20T00:46:27.465469', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.465469', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10092317983972694911, 'uuid_mslong': 18307932424752022267}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'fe12d78a-6d33-42fb-8c0f-1dbc2afa9b7f'}, 'oper': 'CREATE', 'request-id': 'req-8b136175-d697-41c4-a979-41e93c99b86e', 'type': 'hardware', 'uuid': 'fe12d78a-6d33-42fb-8c0f-1dbc2afa9b7f'} 03/20/2025 00:46:27.498 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b9be1540-ad7f-404b-9f70-528ee5f036a5 object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.42:8082/alarm/b9be1540-ad7f-404b-9f70-528ee5f036a5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "b9be1540-ad7f-404b-9f70-528ee5f036a5", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.505 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-jnp10016 url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-jnp10016"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-jnp10016"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.523 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b9be1540-ad7f-404b-9f70-528ee5f036a5 object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.42:8082/alarm/b9be1540-ad7f-404b-9f70-528ee5f036a5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "b9be1540-ad7f-404b-9f70-528ee5f036a5", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.530 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-jnp10016'], 'obj_dict': {'display_name': 'juniper-jnp10016', 'fq_name': ['juniper-jnp10016'], 'id_perms': {'created': '2025-03-20T00:46:27.513766', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.513766', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9536792346643473813, 'uuid_mslong': 883049664621268239}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '0c4138fd-cac7-4d0f-8459-7e1c76592595'}, 'oper': 'CREATE', 'request-id': 'req-8f21ca5f-12a5-42a1-add5-8aa62cf16f2c', 'type': 'hardware', 'uuid': '0c4138fd-cac7-4d0f-8459-7e1c76592595'} 03/20/2025 00:46:27.565 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-ca4e8502-adcf-4e3d-8596-69757568c3d7', 'type': 'alarm', 'uuid': 'b9be1540-ad7f-404b-9f70-528ee5f036a5'} 03/20/2025 00:46:27.578 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-7f0ec268-f55a-4ddd-bcd1-c69024161e33', 'type': 'alarm', 'uuid': 'b9be1540-ad7f-404b-9f70-528ee5f036a5'} 03/20/2025 00:46:27.600 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vmx'], 'obj_dict': {'display_name': 'juniper-vmx', 'fq_name': ['juniper-vmx'], 'id_perms': {'created': '2025-03-20T00:46:27.565085', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.565085', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12874286193268526013, 'uuid_mslong': 9431686312505524301}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '82e414ba-e1ce-404d-b2aa-a714f67c8bbd'}, 'oper': 'CREATE', 'request-id': 'req-a18493d5-6d43-41e0-bee1-41b8e47198ee', 'type': 'hardware', 'uuid': '82e414ba-e1ce-404d-b2aa-a714f67c8bbd'} 03/20/2025 00:46:27.639 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5400'], 'obj_dict': {'display_name': 'juniper-srx5400', 'fq_name': ['juniper-srx5400'], 'id_perms': {'created': '2025-03-20T00:46:27.629117', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.629117', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13183999727149404754, 'uuid_mslong': 1910765516179065982}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '1a84671d-00eb-4c7e-b6f6-f9e667965252'}, 'oper': 'CREATE', 'request-id': 'req-34fbe1d6-ae39-4a49-a1eb-7062f33fbc06', 'type': 'hardware', 'uuid': '1a84671d-00eb-4c7e-b6f6-f9e667965252'} 03/20/2025 00:46:27.660 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx5600 url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx5600"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx5600"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.683 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5600'], 'obj_dict': {'display_name': 'juniper-srx5600', 'fq_name': ['juniper-srx5600'], 'id_perms': {'created': '2025-03-20T00:46:27.671796', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.671796', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11097211078852174948, 'uuid_mslong': 17441923417928908885}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'f20e28ef-f538-4055-9a01-36ae40836464'}, 'oper': 'CREATE', 'request-id': 'req-0f38419b-c4bb-4014-8c84-161810fd8f7e', 'type': 'hardware', 'uuid': 'f20e28ef-f538-4055-9a01-36ae40836464'} 03/20/2025 00:46:27.714 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4600'], 'obj_dict': {'display_name': 'juniper-srx4600', 'fq_name': ['juniper-srx4600'], 'id_perms': {'created': '2025-03-20T00:46:27.705921', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.705921', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10539278909110877950, 'uuid_mslong': 6887839868238250846}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '5f9685dd-e81d-435e-9243-0a540e51fefe'}, 'oper': 'CREATE', 'request-id': 'req-21e132d7-ca59-4b0d-b218-0225cc14d875', 'type': 'hardware', 'uuid': '5f9685dd-e81d-435e-9243-0a540e51fefe'} 03/20/2025 00:46:27.721 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f599f8b8-acce-4574-8066-8db660d03fe0 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.42:8082/alarm/f599f8b8-acce-4574-8066-8db660d03fe0 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "f599f8b8-acce-4574-8066-8db660d03fe0", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.727 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f599f8b8-acce-4574-8066-8db660d03fe0 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.42:8082/alarm/f599f8b8-acce-4574-8066-8db660d03fe0 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "f599f8b8-acce-4574-8066-8db660d03fe0", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.749 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-b1739858-8d55-45c7-8049-71a1c66c45f6', 'type': 'alarm', 'uuid': 'f599f8b8-acce-4574-8066-8db660d03fe0'} 03/20/2025 00:46:27.752 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-982b2427-0a79-4e27-babb-34e027102101', 'type': 'alarm', 'uuid': 'f599f8b8-acce-4574-8066-8db660d03fe0'} 03/20/2025 00:46:27.813 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4100'], 'obj_dict': {'display_name': 'juniper-srx4100', 'fq_name': ['juniper-srx4100'], 'id_perms': {'created': '2025-03-20T00:46:27.776904', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.776904', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11588086072332983269, 'uuid_mslong': 8206267580146994618}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '71e284e2-ae77-4dba-a0d1-26e2f00f1be5'}, 'oper': 'CREATE', 'request-id': 'req-8a4012b7-19e1-45ab-90d2-ff14f5e38f96', 'type': 'hardware', 'uuid': '71e284e2-ae77-4dba-a0d1-26e2f00f1be5'} 03/20/2025 00:46:27.830 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx1500 url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx1500"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx1500"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.851 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx1500'], 'obj_dict': {'display_name': 'juniper-srx1500', 'fq_name': ['juniper-srx1500'], 'id_perms': {'created': '2025-03-20T00:46:27.841770', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.841770', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9591357805779240645, 'uuid_mslong': 9910984663403086640}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '898ae40a-6c7c-4330-851b-591b6f2446c5'}, 'oper': 'CREATE', 'request-id': 'req-48083bff-5918-4710-88ee-85a724846a88', 'type': 'hardware', 'uuid': '898ae40a-6c7c-4330-851b-591b6f2446c5'} 03/20/2025 00:46:27.883 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx240h-poe'], 'obj_dict': {'display_name': 'juniper-srx240h-poe', 'fq_name': ['juniper-srx240h-poe'], 'id_perms': {'created': '2025-03-20T00:46:27.873851', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.873851', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11647326436666187762, 'uuid_mslong': 15547974787463987695}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'd7c580b1-4785-41ef-a1a3-9daf18811ff2'}, 'oper': 'CREATE', 'request-id': 'req-d1a4c9ee-8bbc-41e2-8644-bbfebe666100', 'type': 'hardware', 'uuid': 'd7c580b1-4785-41ef-a1a3-9daf18811ff2'} 03/20/2025 00:46:27.904 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 08b1b6c6-a070-47bd-8038-453eb2ee0fc2 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.42:8082/alarm/08b1b6c6-a070-47bd-8038-453eb2ee0fc2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "08b1b6c6-a070-47bd-8038-453eb2ee0fc2", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.907 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 08b1b6c6-a070-47bd-8038-453eb2ee0fc2 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.42:8082/alarm/08b1b6c6-a070-47bd-8038-453eb2ee0fc2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "08b1b6c6-a070-47bd-8038-453eb2ee0fc2", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:27.935 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-1c399702-7219-442d-92a6-ff1ddfbfb627', 'type': 'alarm', 'uuid': '08b1b6c6-a070-47bd-8038-453eb2ee0fc2'} 03/20/2025 00:46:27.942 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-2c0ea995-274b-4ccd-a4ee-c11641d0a8d4', 'type': 'alarm', 'uuid': '08b1b6c6-a070-47bd-8038-453eb2ee0fc2'} 03/20/2025 00:46:27.964 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5800'], 'obj_dict': {'display_name': 'juniper-srx5800', 'fq_name': ['juniper-srx5800'], 'id_perms': {'created': '2025-03-20T00:46:27.953282', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:27.953282', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9554828894523695948, 'uuid_mslong': 11672235324342814500}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'a1fc1c2f-7238-4724-8499-924183b9234c'}, 'oper': 'CREATE', 'request-id': 'req-3d95efd2-d0ec-49ca-b4a3-55e33d2e665c', 'type': 'hardware', 'uuid': 'a1fc1c2f-7238-4724-8499-924183b9234c'} 03/20/2025 00:46:28.018 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx4200 url = http://10.0.0.42:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx4200"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52627f5e22e14b42b03a971c13c7c866", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx4200"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.037 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4200'], 'obj_dict': {'display_name': 'juniper-srx4200', 'fq_name': ['juniper-srx4200'], 'id_perms': {'created': '2025-03-20T00:46:28.030942', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:28.030942', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10077483886050821200, 'uuid_mslong': 12613346624816824834}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'af0b9bed-4914-4202-8bda-6a3399c84450'}, 'oper': 'CREATE', 'request-id': 'req-7f2d881f-0289-49a2-8cc9-1795314edd6d', 'type': 'hardware', 'uuid': 'af0b9bed-4914-4202-8bda-6a3399c84450'} 03/20/2025 00:46:28.077 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vsrx'], 'obj_dict': {'display_name': 'juniper-vsrx', 'fq_name': ['juniper-vsrx'], 'id_perms': {'created': '2025-03-20T00:46:28.065009', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:28.065009', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13431665105315288106, 'uuid_mslong': 2603906172515601868}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '2422eede-293d-4dcc-ba66-dc3fd053d42a'}, 'oper': 'CREATE', 'request-id': 'req-ac8253cc-4f39-437d-9218-2c968b828052', 'type': 'hardware', 'uuid': '2422eede-293d-4dcc-ba66-dc3fd053d42a'} 03/20/2025 00:46:28.080 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4c365283-3f6b-4ce3-98fb-4d5564da3a54 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.42:8082/alarm/4c365283-3f6b-4ce3-98fb-4d5564da3a54 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "4c365283-3f6b-4ce3-98fb-4d5564da3a54", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.105 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4c365283-3f6b-4ce3-98fb-4d5564da3a54 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.42:8082/alarm/4c365283-3f6b-4ce3-98fb-4d5564da3a54 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "4c365283-3f6b-4ce3-98fb-4d5564da3a54", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.112 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-90cc9ab6-3d21-43d8-8a39-e2b1205abcbf', 'type': 'alarm', 'uuid': '4c365283-3f6b-4ce3-98fb-4d5564da3a54'} 03/20/2025 00:46:28.137 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-51d6bb13-341d-45a6-8e23-6936df805f47', 'type': 'alarm', 'uuid': '4c365283-3f6b-4ce3-98fb-4d5564da3a54'} 03/20/2025 00:46:28.170 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'underlay-ip-clos'], 'obj_dict': {'display_name': 'underlay-ip-clos', 'fq_name': ['default-global-system-config', 'underlay-ip-clos'], 'id_perms': {'created': '2025-03-20T00:46:28.163551', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:28.163551', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10771456224644280838, 'uuid_mslong': 4683411781124899389}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '40fed233-7ed4-423d-957b-e65ddf97b206'}, 'oper': 'CREATE', 'request-id': 'req-a233b896-8e3a-4633-9138-895e67608643', 'type': 'feature', 'uuid': '40fed233-7ed4-423d-957b-e65ddf97b206'} 03/20/2025 00:46:28.192 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:overlay-bgp url = http://10.0.0.42:8082/features operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "overlay-bgp"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "overlay-bgp"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.228 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'overlay-bgp'], 'obj_dict': {'display_name': 'overlay-bgp', 'fq_name': ['default-global-system-config', 'overlay-bgp'], 'id_perms': {'created': '2025-03-20T00:46:28.216397', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:28.216397', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10243178221289359412, 'uuid_mslong': 1145560475698348168}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0fe5d92e-e6ba-4088-8e27-145252f84834'}, 'oper': 'CREATE', 'request-id': 'req-8a6dbf5c-8a3d-4941-86c5-917cf6f64818', 'type': 'feature', 'uuid': '0fe5d92e-e6ba-4088-8e27-145252f84834'} 03/20/2025 00:46:28.271 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ca5c7bd2-8580-4f61-9f45-597270fd3915 object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.42:8082/alarm/ca5c7bd2-8580-4f61-9f45-597270fd3915 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "ca5c7bd2-8580-4f61-9f45-597270fd3915", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.295 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'l2-gateway'], 'obj_dict': {'display_name': 'l2-gateway', 'fq_name': ['default-global-system-config', 'l2-gateway'], 'id_perms': {'created': '2025-03-20T00:46:28.279956', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:28.279956', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13581342001131636568, 'uuid_mslong': 4758111194327303181}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '420834eb-f3b0-440d-bc7a-9e97ce8b4758'}, 'oper': 'CREATE', 'request-id': 'req-664fedfc-f4c6-4ce0-a674-6a3237c5c7cf', 'type': 'feature', 'uuid': '420834eb-f3b0-440d-bc7a-9e97ce8b4758'} 03/20/2025 00:46:28.303 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ca5c7bd2-8580-4f61-9f45-597270fd3915 object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.42:8082/alarm/ca5c7bd2-8580-4f61-9f45-597270fd3915 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "ca5c7bd2-8580-4f61-9f45-597270fd3915", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.314 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-21671c5c-baa3-4250-bd51-670ed759b9bc', 'type': 'alarm', 'uuid': 'ca5c7bd2-8580-4f61-9f45-597270fd3915'} 03/20/2025 00:46:28.329 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-3af10e56-961c-42aa-8161-f983ff3a320a', 'type': 'alarm', 'uuid': 'ca5c7bd2-8580-4f61-9f45-597270fd3915'} 03/20/2025 00:46:28.360 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'l3-gateway'], 'obj_dict': {'display_name': 'l3-gateway', 'fq_name': ['default-global-system-config', 'l3-gateway'], 'id_perms': {'created': '2025-03-20T00:46:28.351846', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:28.351846', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12555688924695468962, 'uuid_mslong': 17381484914153702646}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f1377070-38f1-44f6-ae3e-c48ddac79ba2'}, 'oper': 'CREATE', 'request-id': 'req-5eba7dcc-dcf7-4394-ad49-e0b0d56c0171', 'type': 'feature', 'uuid': 'f1377070-38f1-44f6-ae3e-c48ddac79ba2'} 03/20/2025 00:46:28.395 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:vn-interconnect url = http://10.0.0.42:8082/features operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "vn-interconnect"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vn-interconnect"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.455 7fabc20e9240 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.12 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.478 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9fc2de9a-a509-4f4c-ba90-38e77eb05d73 object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.42:8082/alarm/9fc2de9a-a509-4f4c-ba90-38e77eb05d73 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "9fc2de9a-a509-4f4c-ba90-38e77eb05d73", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.492 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'vn-interconnect'], 'obj_dict': {'display_name': 'vn-interconnect', 'fq_name': ['default-global-system-config', 'vn-interconnect'], 'id_perms': {'created': '2025-03-20T00:46:28.454468', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:28.454468', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11490743192230770252, 'uuid_mslong': 9006387174402051969}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7cfd1d6a-cfde-4f81-9f77-520d8227364c'}, 'oper': 'CREATE', 'request-id': 'req-45021531-5081-47e3-942c-486ab923301e', 'type': 'feature', 'uuid': '7cfd1d6a-cfde-4f81-9f77-520d8227364c'} 03/20/2025 00:46:28.498 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9fc2de9a-a509-4f4c-ba90-38e77eb05d73 object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.42:8082/alarm/9fc2de9a-a509-4f4c-ba90-38e77eb05d73 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "9fc2de9a-a509-4f4c-ba90-38e77eb05d73", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.507 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-033e5435-09ab-488c-9351-26a897d998b3', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 00:46:28.542 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-427f1ff2-a8df-492b-a503-197bc629258f', 'type': 'alarm', 'uuid': '9fc2de9a-a509-4f4c-ba90-38e77eb05d73'} 03/20/2025 00:46:28.563 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway'], 'obj_dict': {'display_name': 'dc-gateway', 'fq_name': ['default-global-system-config', 'dc-gateway'], 'id_perms': {'created': '2025-03-20T00:46:28.541150', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:28.541150', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13621132602717501774, 'uuid_mslong': 17950151555143386606}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f91bbfbc-44bf-45ee-bd07-fbef2f77f94e'}, 'oper': 'CREATE', 'request-id': 'req-942555b7-a8ee-4ac2-beea-ca705214520a', 'type': 'feature', 'uuid': 'f91bbfbc-44bf-45ee-bd07-fbef2f77f94e'} 03/20/2025 00:46:28.567 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-f1be3a73-fb94-45b7-8617-2e918a877e5c', 'type': 'alarm', 'uuid': '9fc2de9a-a509-4f4c-ba90-38e77eb05d73'} 03/20/2025 00:46:28.634 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'fq_name': ['default-global-system-config', 'assisted-replicator'], 'id_perms': {'created': '2025-03-20T00:46:28.620558', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:28.620558', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12106842354573802504, 'uuid_mslong': 13607106440177271400}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bcd62736-bbb2-4268-a804-24fa08067c08'}, 'oper': 'CREATE', 'request-id': 'req-0115a07c-e4b8-4112-9db0-7744fc972548', 'type': 'feature', 'uuid': 'bcd62736-bbb2-4268-a804-24fa08067c08'} 03/20/2025 00:46:28.666 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:port-profile url = http://10.0.0.42:8082/features operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "port-profile"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "port-profile"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.699 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8b6abc1c-bd01-4612-85ab-0a0e23cecc68 object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.42:8082/alarm/8b6abc1c-bd01-4612-85ab-0a0e23cecc68 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "8b6abc1c-bd01-4612-85ab-0a0e23cecc68", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.706 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8b6abc1c-bd01-4612-85ab-0a0e23cecc68 object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.42:8082/alarm/8b6abc1c-bd01-4612-85ab-0a0e23cecc68 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "8b6abc1c-bd01-4612-85ab-0a0e23cecc68", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.708 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'port-profile'], 'obj_dict': {'display_name': 'port-profile', 'fq_name': ['default-global-system-config', 'port-profile'], 'id_perms': {'created': '2025-03-20T00:46:28.698076', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:28.698076', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10529614916163314178, 'uuid_mslong': 5504659433754345979}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4c647a97-0e6e-41fb-9220-b4fa5b91a202'}, 'oper': 'CREATE', 'request-id': 'req-4e3a41e2-34c8-4439-8d0c-bc9357656817', 'type': 'feature', 'uuid': '4c647a97-0e6e-41fb-9220-b4fa5b91a202'} 03/20/2025 00:46:28.741 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-e60cc147-ab12-4127-89b8-aaf3b6708947', 'type': 'alarm', 'uuid': '8b6abc1c-bd01-4612-85ab-0a0e23cecc68'} 03/20/2025 00:46:28.748 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-7e5dbb8c-48a7-4b10-9f17-e29f4f45f1cc', 'type': 'alarm', 'uuid': '8b6abc1c-bd01-4612-85ab-0a0e23cecc68'} 03/20/2025 00:46:28.796 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'telemetry'], 'obj_dict': {'display_name': 'telemetry', 'fq_name': ['default-global-system-config', 'telemetry'], 'id_perms': {'created': '2025-03-20T00:46:28.773723', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:28.773723', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12827199982370734582, 'uuid_mslong': 13341133975666770547}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b9253aaa-a083-4273-b203-5e6c2c1ac1f6'}, 'oper': 'CREATE', 'request-id': 'req-09c4b6aa-9dd6-4375-b16e-01b1f2bb5b9b', 'type': 'feature', 'uuid': 'b9253aaa-a083-4273-b203-5e6c2c1ac1f6'} 03/20/2025 00:46:28.871 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'firewall'], 'obj_dict': {'display_name': 'firewall', 'fq_name': ['default-global-system-config', 'firewall'], 'id_perms': {'created': '2025-03-20T00:46:28.864429', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:28.864429', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10572621546432554218, 'uuid_mslong': 1235139321243190275}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '112418ab-2ad1-4403-92b9-7f47c3c0e4ea'}, 'oper': 'CREATE', 'request-id': 'req-5c7a7816-307e-4336-b7a5-6b66d1089dfa', 'type': 'feature', 'uuid': '112418ab-2ad1-4403-92b9-7f47c3c0e4ea'} 03/20/2025 00:46:28.889 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = cc74187c-06a9-4d6b-8d8e-650afaf4a9e2 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.42:8082/alarm/cc74187c-06a9-4d6b-8d8e-650afaf4a9e2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "cc74187c-06a9-4d6b-8d8e-650afaf4a9e2", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.895 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:infra-bms-access url = http://10.0.0.42:8082/features operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "infra-bms-access"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "infra-bms-access"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.897 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = cc74187c-06a9-4d6b-8d8e-650afaf4a9e2 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.42:8082/alarm/cc74187c-06a9-4d6b-8d8e-650afaf4a9e2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "cc74187c-06a9-4d6b-8d8e-650afaf4a9e2", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:28.922 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-9345b6a2-b607-4e37-ba51-d68e70e22c60', 'type': 'alarm', 'uuid': 'cc74187c-06a9-4d6b-8d8e-650afaf4a9e2'} 03/20/2025 00:46:28.932 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-3bb5a877-034e-4152-924e-d4b5bdeb8e71', 'type': 'alarm', 'uuid': 'cc74187c-06a9-4d6b-8d8e-650afaf4a9e2'} 03/20/2025 00:46:28.949 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'infra-bms-access'], 'obj_dict': {'display_name': 'infra-bms-access', 'fq_name': ['default-global-system-config', 'infra-bms-access'], 'id_perms': {'created': '2025-03-20T00:46:28.942280', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:28.942280', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9647797015604667322, 'uuid_mslong': 9648221038052262668}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '85e55dea-678e-430c-85e3-dc44fc30a3ba'}, 'oper': 'CREATE', 'request-id': 'req-53d9246b-fbeb-4fc2-9904-1cd48f3d5ade', 'type': 'feature', 'uuid': '85e55dea-678e-430c-85e3-dc44fc30a3ba'} 03/20/2025 00:46:29.027 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-service-chaining'], 'obj_dict': {'display_name': 'pnf-service-chaining', 'fq_name': ['default-global-system-config', 'pnf-service-chaining'], 'id_perms': {'created': '2025-03-20T00:46:29.014544', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.014544', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12898296334348163103, 'uuid_mslong': 11019160773205051175}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '98ebec57-59ce-4727-b2ff-f42d908b981f'}, 'oper': 'CREATE', 'request-id': 'req-ed430e41-806f-430b-a396-fbab51080cf4', 'type': 'feature', 'uuid': '98ebec57-59ce-4727-b2ff-f42d908b981f'} 03/20/2025 00:46:29.084 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2c9b02ba-35bc-4d67-86d4-0e010edd049b object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.42:8082/alarm/2c9b02ba-35bc-4d67-86d4-0e010edd049b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "2c9b02ba-35bc-4d67-86d4-0e010edd049b", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:29.089 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2c9b02ba-35bc-4d67-86d4-0e010edd049b object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.42:8082/alarm/2c9b02ba-35bc-4d67-86d4-0e010edd049b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "2c9b02ba-35bc-4d67-86d4-0e010edd049b", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:29.099 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'leaf'], 'obj_dict': {'display_name': 'leaf', 'fq_name': ['default-global-system-config', 'leaf'], 'id_perms': {'created': '2025-03-20T00:46:29.088642', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.088642', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13481814955526904218, 'uuid_mslong': 5925121191360351857}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '523a4254-b62c-4e71-bb19-0745b7bad99a'}, 'oper': 'CREATE', 'request-id': 'req-1a7d0701-40f3-49d1-8051-3d1355f45697', 'type': 'physical_role', 'uuid': '523a4254-b62c-4e71-bb19-0745b7bad99a'} 03/20/2025 00:46:29.113 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-6b109206-5688-426a-bf69-47f7de6ab2ea', 'type': 'alarm', 'uuid': '2c9b02ba-35bc-4d67-86d4-0e010edd049b'} 03/20/2025 00:46:29.125 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-c1d6c48c-70ac-4fc5-aca2-ca161838d539', 'type': 'alarm', 'uuid': '2c9b02ba-35bc-4d67-86d4-0e010edd049b'} 03/20/2025 00:46:29.131 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:spine url = http://10.0.0.42:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "spine"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:29.182 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'spine'], 'obj_dict': {'display_name': 'spine', 'fq_name': ['default-global-system-config', 'spine'], 'id_perms': {'created': '2025-03-20T00:46:29.164872', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.164872', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13350784128773732940, 'uuid_mslong': 10013283337739587393}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8af65424-9d4e-4f41-b947-836dfc7b3a4c'}, 'oper': 'CREATE', 'request-id': 'req-eec1efd7-fce3-4d1e-b6c4-1114371c0d7d', 'type': 'physical_role', 'uuid': '8af65424-9d4e-4f41-b947-836dfc7b3a4c'} 03/20/2025 00:46:29.233 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'superspine'], 'obj_dict': {'display_name': 'superspine', 'fq_name': ['default-global-system-config', 'superspine'], 'id_perms': {'created': '2025-03-20T00:46:29.225219', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.225219', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10882779740568572426, 'uuid_mslong': 10694064782986724498}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9468f342-b2f0-4492-9707-6683bd68520a'}, 'oper': 'CREATE', 'request-id': 'req-065a3b57-ecdd-427b-83ca-bba49cb7ec7b', 'type': 'physical_role', 'uuid': '9468f342-b2f0-4492-9707-6683bd68520a'} 03/20/2025 00:46:29.262 7fabc227be10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bcb5ab76-d8ec-4914-b025-04833530d175 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.42:8082/alarm/bcb5ab76-d8ec-4914-b025-04833530d175 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "bcb5ab76-d8ec-4914-b025-04833530d175", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:29.282 7fabc2298978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bcb5ab76-d8ec-4914-b025-04833530d175 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.42:8082/alarm/bcb5ab76-d8ec-4914-b025-04833530d175 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "bcb5ab76-d8ec-4914-b025-04833530d175", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:29.296 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf'], 'obj_dict': {'display_name': 'pnf', 'fq_name': ['default-global-system-config', 'pnf'], 'id_perms': {'created': '2025-03-20T00:46:29.283126', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.283126', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10258971985989529983, 'uuid_mslong': 8511217100440290180}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '761deadb-c5f9-4384-8e5f-30aab996f17f'}, 'oper': 'CREATE', 'request-id': 'req-803d1da2-1b40-4dab-a162-93255cd93bcd', 'type': 'physical_role', 'uuid': '761deadb-c5f9-4384-8e5f-30aab996f17f'} 03/20/2025 00:46:29.315 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-6cfac689-9dc6-41b6-8041-0f57253320e0', 'type': 'alarm', 'uuid': 'bcb5ab76-d8ec-4914-b025-04833530d175'} 03/20/2025 00:46:29.328 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-9378337f-9e9c-4a63-a609-3c954fbfef57', 'type': 'alarm', 'uuid': 'bcb5ab76-d8ec-4914-b025-04833530d175'} 03/20/2025 00:46:29.330 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:erb-ucast-gateway url = http://10.0.0.42:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "erb-ucast-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "erb-ucast-gateway"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:29.382 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-ucast-gateway'], 'obj_dict': {'display_name': 'erb-ucast-gateway', 'fq_name': ['default-global-system-config', 'erb-ucast-gateway'], 'id_perms': {'created': '2025-03-20T00:46:29.361349', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.361349', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11723558932071692731, 'uuid_mslong': 16821907159603627407}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e9736b6f-74c6-458f-a2b2-72bc117db9bb'}, 'oper': 'CREATE', 'request-id': 'req-adf3eb1f-8563-4aac-9eff-e3c81c657efb', 'type': 'overlay_role', 'uuid': 'e9736b6f-74c6-458f-a2b2-72bc117db9bb'} 03/20/2025 00:46:29.440 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access'], 'obj_dict': {'display_name': 'crb-access', 'fq_name': ['default-global-system-config', 'crb-access'], 'id_perms': {'created': '2025-03-20T00:46:29.431974', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.431974', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12303874400975287107, 'uuid_mslong': 13991922148297165005}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c22d4b0f-be2c-48cd-aac0-249437277343'}, 'oper': 'CREATE', 'request-id': 'req-8fd9ac8c-d2df-4d70-9da9-0653c34b1532', 'type': 'overlay_role', 'uuid': 'c22d4b0f-be2c-48cd-aac0-249437277343'} 03/20/2025 00:46:29.455 7fabc20678d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.12 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:29.467 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-9d1378f2-6be0-457c-87a7-c24db01f9fd7', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 00:46:29.503 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'obj_dict': {'display_name': 'crb-mcast-gateway', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'id_perms': {'created': '2025-03-20T00:46:29.493875', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.493875', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10722220249637606011, 'uuid_mslong': 2706675093656784753}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '25900aa8-37cf-4f71-94cc-fa821f26527b'}, 'oper': 'CREATE', 'request-id': 'req-429f4ccc-9b3b-4373-b783-d74843326716', 'type': 'overlay_role', 'uuid': '25900aa8-37cf-4f71-94cc-fa821f26527b'} 03/20/2025 00:46:29.524 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-gateway url = http://10.0.0.42:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-gateway"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:29.557 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway'], 'obj_dict': {'display_name': 'crb-gateway', 'fq_name': ['default-global-system-config', 'crb-gateway'], 'id_perms': {'created': '2025-03-20T00:46:29.550623', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.550623', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11435281198968955360, 'uuid_mslong': 16601375869571187909}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e663ef65-4088-44c5-9eb2-47a9eb3f61e0'}, 'oper': 'CREATE', 'request-id': 'req-4f2c3131-94f4-4cc7-8a2d-3e5fdfc47794', 'type': 'overlay_role', 'uuid': 'e663ef65-4088-44c5-9eb2-47a9eb3f61e0'} 03/20/2025 00:46:29.601 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'obj_dict': {'display_name': 'collapsed-spine', 'fq_name': ['default-global-system-config', 'collapsed-spine'], 'id_perms': {'created': '2025-03-20T00:46:29.593416', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.593416', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10926280884704474273, 'uuid_mslong': 13824694095015594389}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bfdb2e08-75d8-4995-97a1-f29320f374a1'}, 'oper': 'CREATE', 'request-id': 'req-8572587c-d4ed-4d9b-91cf-c10262df7112', 'type': 'overlay_role', 'uuid': 'bfdb2e08-75d8-4995-97a1-f29320f374a1'} 03/20/2025 00:46:29.627 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'oper': 'UPDATE', 'request-id': 'req-791c9951-4e20-4539-bc71-e0268c6e985e', 'type': 'overlay_role', 'uuid': '25900aa8-37cf-4f71-94cc-fa821f26527b'} 03/20/2025 00:46:29.687 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:dc-gateway url = http://10.0.0.42:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:29.715 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway'], 'obj_dict': {'display_name': 'dc-gateway', 'fq_name': ['default-global-system-config', 'dc-gateway'], 'id_perms': {'created': '2025-03-20T00:46:29.707294', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.707294', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9433459291271922100, 'uuid_mslong': 16665091358708352647}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e7464c4b-993e-4687-82ea-613eab5f01b4'}, 'oper': 'CREATE', 'request-id': 'req-d601e8e8-543a-4fdd-a2f1-daead947627d', 'type': 'overlay_role', 'uuid': 'e7464c4b-993e-4687-82ea-613eab5f01b4'} 03/20/2025 00:46:29.762 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway'], 'obj_dict': {'display_name': 'dci-gateway', 'fq_name': ['default-global-system-config', 'dci-gateway'], 'id_perms': {'created': '2025-03-20T00:46:29.753834', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.753834', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12491635219959516392, 'uuid_mslong': 14244653900485183038}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c5af2d40-46cd-463e-ad5b-340c8d720ce8'}, 'oper': 'CREATE', 'request-id': 'req-fb26fcd4-26d9-4298-8df2-f11fd11cb8ec', 'type': 'overlay_role', 'uuid': 'c5af2d40-46cd-463e-ad5b-340c8d720ce8'} 03/20/2025 00:46:29.805 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client'], 'obj_dict': {'display_name': 'ar-client', 'fq_name': ['default-global-system-config', 'ar-client'], 'id_perms': {'created': '2025-03-20T00:46:29.798624', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.798624', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12572805176851723111, 'uuid_mslong': 4166391183487749930}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '39d1feb4-f71b-4f2a-ae7b-93b1dc707367'}, 'oper': 'CREATE', 'request-id': 'req-8548b4f3-e553-4107-b291-8cc5378ba7c3', 'type': 'overlay_role', 'uuid': '39d1feb4-f71b-4f2a-ae7b-93b1dc707367'} 03/20/2025 00:46:29.821 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:ar-replicator url = http://10.0.0.42:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "ar-replicator"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-replicator"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:29.849 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator'], 'obj_dict': {'display_name': 'ar-replicator', 'fq_name': ['default-global-system-config', 'ar-replicator'], 'id_perms': {'created': '2025-03-20T00:46:29.841105', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.841105', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10352852974414867450, 'uuid_mslong': 3094042188195318251}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2af03efa-2b74-49eb-8fac-b8edafd82bfa'}, 'oper': 'CREATE', 'request-id': 'req-ee556ddb-ea23-4de2-9e4c-1b2e81e9f4e7', 'type': 'overlay_role', 'uuid': '2af03efa-2b74-49eb-8fac-b8edafd82bfa'} 03/20/2025 00:46:29.903 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'route-reflector'], 'obj_dict': {'display_name': 'route-reflector', 'fq_name': ['default-global-system-config', 'route-reflector'], 'id_perms': {'created': '2025-03-20T00:46:29.894565', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.894565', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12368469128703086868, 'uuid_mslong': 4458698974023470391}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3de07b17-fb11-4d37-aba5-a1243fbb9114'}, 'oper': 'CREATE', 'request-id': 'req-3fb790a1-8c57-4e9d-937a-dc2bf92cde99', 'type': 'overlay_role', 'uuid': '3de07b17-fb11-4d37-aba5-a1243fbb9114'} 03/20/2025 00:46:29.952 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean'], 'obj_dict': {'display_name': 'lean', 'fq_name': ['default-global-system-config', 'lean'], 'id_perms': {'created': '2025-03-20T00:46:29.945838', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.945838', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13753199143884178545, 'uuid_mslong': 15676352423606569425}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd98d9778-eee7-49d1-bedd-2dc0f86c4471'}, 'oper': 'CREATE', 'request-id': 'req-cae0882e-73c0-4357-911b-ae30cfa1b2d7', 'type': 'overlay_role', 'uuid': 'd98d9778-eee7-49d1-bedd-2dc0f86c4471'} 03/20/2025 00:46:29.969 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:pnf-servicechain url = http://10.0.0.42:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-servicechain"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-servicechain"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:30.007 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain'], 'obj_dict': {'display_name': 'pnf-servicechain', 'fq_name': ['default-global-system-config', 'pnf-servicechain'], 'id_perms': {'created': '2025-03-20T00:46:29.994365', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:29.994365', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11726651943040671148, 'uuid_mslong': 10253988631012525930}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8e4d7c54-fa65-476a-a2bd-6fcfcd955dac'}, 'oper': 'CREATE', 'request-id': 'req-350f82c8-5749-49ad-9f8b-cf8d9bb6474b', 'type': 'overlay_role', 'uuid': '8e4d7c54-fa65-476a-a2bd-6fcfcd955dac'} 03/20/2025 00:46:30.075 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'obj_dict': {'display_name': 'erb-leaf', 'fq_name': ['default-global-system-config', 'erb-leaf'], 'id_perms': {'created': '2025-03-20T00:46:30.057174', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:30.057174', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13479461030473950561, 'uuid_mslong': 18073483444853297067}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'}, 'oper': 'CREATE', 'request-id': 'req-85a2d1cf-ed83-4efb-8d24-d103d9ab3f70', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 00:46:30.119 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'obj_dict': {'display_name': 'crb-access-leaf', 'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'id_perms': {'created': '2025-03-20T00:46:30.111589', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:30.111589', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9228778230305449678, 'uuid_mslong': 3010208871476645335}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'}, 'oper': 'CREATE', 'request-id': 'req-3bbb587d-6fb4-499b-879f-a9ad7e4c137e', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 00:46:30.141 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = http://10.0.0.42:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access-spine"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:30.183 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'obj_dict': {'display_name': 'crb-access-spine', 'fq_name': ['default-global-system-config', 'crb-access-spine'], 'id_perms': {'created': '2025-03-20T00:46:30.174293', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:30.174293', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9342667685977116862, 'uuid_mslong': 10112387559950077545}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'}, 'oper': 'CREATE', 'request-id': 'req-bd50a574-dbc6-47b6-8012-89cf00d169b7', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 00:46:30.237 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'obj_dict': {'display_name': 'crb-gateway-spine', 'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'id_perms': {'created': '2025-03-20T00:46:30.224130', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:30.224130', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9275277264814184048, 'uuid_mslong': 13537511783104137025}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'}, 'oper': 'CREATE', 'request-id': 'req-d9a7201f-b3a3-4e7b-8368-d44ee258df7e', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 00:46:30.281 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'obj_dict': {'display_name': 'crb-mcast-gateway-spine', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'id_perms': {'created': '2025-03-20T00:46:30.274344', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:30.274344', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11452092677690978647, 'uuid_mslong': 2965230035248497883}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'}, 'oper': 'CREATE', 'request-id': 'req-1057d00e-ed6a-4819-a70b-4de6cb129279', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 00:46:30.316 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.42:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "collapsed-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "collapsed-spine"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:30.358 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'obj_dict': {'display_name': 'collapsed-spine', 'fq_name': ['default-global-system-config', 'collapsed-spine'], 'id_perms': {'created': '2025-03-20T00:46:30.349989', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:30.349989', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9820580156295734501, 'uuid_mslong': 17111981107334041342}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'}, 'oper': 'CREATE', 'request-id': 'req-bde62bd7-0bab-47c6-9435-66e89c27f812', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 00:46:30.428 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'obj_dict': {'display_name': 'dc-gateway-spine', 'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'id_perms': {'created': '2025-03-20T00:46:30.419790', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:30.419790', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13373646712853511791, 'uuid_mslong': 17346357602588183624}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'}, 'oper': 'CREATE', 'request-id': 'req-02384310-b378-4ec4-aa78-247d9122f39c', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 00:46:30.479 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'obj_dict': {'display_name': 'dci-gateway-spine', 'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'id_perms': {'created': '2025-03-20T00:46:30.469793', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:30.469793', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11970894635523333679, 'uuid_mslong': 1915550531135686284}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'}, 'oper': 'CREATE', 'request-id': 'req-200b0c6c-6d41-4705-96f7-e73ec078f6dc', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 00:46:30.499 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = http://10.0.0.42:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-gateway-leaf"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:30.562 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'obj_dict': {'display_name': 'crb-gateway-leaf', 'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'id_perms': {'created': '2025-03-20T00:46:30.550609', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:30.550609', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13362967560776675556, 'uuid_mslong': 16291534084348725163}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'}, 'oper': 'CREATE', 'request-id': 'req-91f8e413-bdf7-4c2e-b4fc-6c877cd5a362', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 00:46:30.631 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'obj_dict': {'display_name': 'crb-mcast-gateway-leaf', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'id_perms': {'created': '2025-03-20T00:46:30.617512', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:30.617512', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10140304510057363690, 'uuid_mslong': 14182224777351153241}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'}, 'oper': 'CREATE', 'request-id': 'req-da35fdec-dda7-4071-b717-03a40fad7e68', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 00:46:30.720 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'obj_dict': {'display_name': 'dc-gateway-leaf', 'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'id_perms': {'created': '2025-03-20T00:46:30.710627', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:30.710627', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12686457997073743090, 'uuid_mslong': 13498282410716447177}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'}, 'oper': 'CREATE', 'request-id': 'req-32b4572e-13e8-4038-bef2-947c088e7239', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 00:46:30.744 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = http://10.0.0.42:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dci-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dci-gateway-leaf"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:30.748 7fabc2182198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:30.749 7fabc2182198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:30.752 7fabc2182198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:30.752 7fabc2182198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:30.752 7fabc2182198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:30.752 7fabc2182198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:30.752 7fabc2182198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:30.752 7fabc2182198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:30.752 7fabc2182198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:30.752 7fabc2182198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:30.752 7fabc2182198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:30.753 7fabc2182198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:30.753 7fabc2182198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:46:30.753 7fabc2182198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:30.785 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'obj_dict': {'display_name': 'dci-gateway-leaf', 'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'id_perms': {'created': '2025-03-20T00:46:30.776288', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:30.776288', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10665720116245913269, 'uuid_mslong': 12681922495376214808}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'}, 'oper': 'CREATE', 'request-id': 'req-1f09447d-acf4-415e-babc-20b0e7799898', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 00:46:30.847 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'obj_dict': {'display_name': 'ar-client-leaf', 'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'id_perms': {'created': '2025-03-20T00:46:30.836333', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:30.836333', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11620890694323277612, 'uuid_mslong': 4918468923004961108}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4441e96d-2282-4154-a145-b28430c80f2c'}, 'oper': 'CREATE', 'request-id': 'req-36f8e958-f4bb-4e71-aa30-150641912142', 'type': 'role_definition', 'uuid': '4441e96d-2282-4154-a145-b28430c80f2c'} 03/20/2025 00:46:30.934 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'obj_dict': {'display_name': 'ar-client-spine', 'fq_name': ['default-global-system-config', 'ar-client-spine'], 'id_perms': {'created': '2025-03-20T00:46:30.916308', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:30.916308', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11712575181778657227, 'uuid_mslong': 14554755281443374072}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c9fce0d0-672c-43f8-a28b-6d126af91fcb'}, 'oper': 'CREATE', 'request-id': 'req-fd90556d-edfa-4cb0-8df8-341e1b8d8f3c', 'type': 'role_definition', 'uuid': 'c9fce0d0-672c-43f8-a28b-6d126af91fcb'} 03/20/2025 00:46:30.970 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = http://10.0.0.42:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-replicator-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-replicator-leaf"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:31.030 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'obj_dict': {'display_name': 'ar-replicator-leaf', 'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'id_perms': {'created': '2025-03-20T00:46:31.005918', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:31.005918', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10510109899629583169, 'uuid_mslong': 11275198469778459817}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'}, 'oper': 'CREATE', 'request-id': 'req-7527564a-7c2c-4a33-806a-505b8be47c1f', 'type': 'role_definition', 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'} 03/20/2025 00:46:31.077 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'obj_dict': {'display_name': 'ar-replicator-spine', 'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'id_perms': {'created': '2025-03-20T00:46:31.061270', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:31.061270', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13569000062768528912, 'uuid_mslong': 13533641288298482954}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'}, 'oper': 'CREATE', 'request-id': 'req-a899b687-c596-41c6-9fd7-a31f965b02ba', 'type': 'role_definition', 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'} 03/20/2025 00:46:31.129 7fabc2082630 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.47 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:31.153 7fabc21e64e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/global-system-config/92e769a6-5754-45f5-bd68-145125efbf0e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"global-system-config": {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:31.164 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-944765f1-43d9-480b-9cd5-829d4662d6ef', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 00:46:31.174 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'obj_dict': {'display_name': 'rr-spine', 'fq_name': ['default-global-system-config', 'rr-spine'], 'id_perms': {'created': '2025-03-20T00:46:31.152717', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:31.152717', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13503136769837585846, 'uuid_mslong': 8254621473300565362}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'}, 'oper': 'CREATE', 'request-id': 'req-bdc0ec10-3aae-4e37-830f-664353030b30', 'type': 'role_definition', 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'} 03/20/2025 00:46:31.199 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = http://10.0.0.42:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "rr-superspine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "rr-superspine"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:31.231 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-38860284-b6d2-4db0-8607-78fd2ccd51c9', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 00:46:31.252 7fabc20bd390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.42 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:31.260 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'obj_dict': {'display_name': 'rr-superspine', 'fq_name': ['default-global-system-config', 'rr-superspine'], 'id_perms': {'created': '2025-03-20T00:46:31.249835', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:31.249835', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12559009178085512310, 'uuid_mslong': 3884081042933171584}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'}, 'oper': 'CREATE', 'request-id': 'req-09f83620-a134-46f0-8059-8b73a96fd928', 'type': 'role_definition', 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'} 03/20/2025 00:46:31.278 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-fc357572-5b87-4834-a4d3-89c3d6f8853f', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 00:46:31.340 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'obj_dict': {'display_name': 'rr-leaf', 'fq_name': ['default-global-system-config', 'rr-leaf'], 'id_perms': {'created': '2025-03-20T00:46:31.330054', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:31.330054', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9547744170588998227, 'uuid_mslong': 17147695403958814889}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'}, 'oper': 'CREATE', 'request-id': 'req-6d128b0a-44a2-47c1-9637-ad267d7ec5b0', 'type': 'role_definition', 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'} 03/20/2025 00:46:31.397 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'obj_dict': {'display_name': 'lean-spine', 'fq_name': ['default-global-system-config', 'lean-spine'], 'id_perms': {'created': '2025-03-20T00:46:31.388269', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:31.388269', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11516444458816572231, 'uuid_mslong': 6168050406118214453}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5599512a-2561-4b35-9fd2-a137f3470b47'}, 'oper': 'CREATE', 'request-id': 'req-78470ef3-9aa8-45c4-8840-7822d108bb7d', 'type': 'role_definition', 'uuid': '5599512a-2561-4b35-9fd2-a137f3470b47'} 03/20/2025 00:46:31.416 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = http://10.0.0.42:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "lean-superspine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "lean-superspine"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:31.467 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'obj_dict': {'display_name': 'lean-superspine', 'fq_name': ['default-global-system-config', 'lean-superspine'], 'id_perms': {'created': '2025-03-20T00:46:31.452970', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:31.452970', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12915851926684123895, 'uuid_mslong': 10118571927480323109}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8c6c638e-bbb4-4c25-b33e-52e56d8d42f7'}, 'oper': 'CREATE', 'request-id': 'req-9bb273ed-6a74-4171-9b51-64f7ff788e4c', 'type': 'role_definition', 'uuid': '8c6c638e-bbb4-4c25-b33e-52e56d8d42f7'} 03/20/2025 00:46:31.544 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'obj_dict': {'display_name': 'pnf-servicechain-pnf', 'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'id_perms': {'created': '2025-03-20T00:46:31.531637', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:31.531637', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11808886874371221521, 'uuid_mslong': 5295688385271121738}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '497e1087-553f-474a-a3e1-980bcbab6811'}, 'oper': 'CREATE', 'request-id': 'req-8f02c6d3-5eba-4f91-8bae-0f447ec9aefe', 'type': 'role_definition', 'uuid': '497e1087-553f-474a-a3e1-980bcbab6811'} 03/20/2025 00:46:31.615 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'obj_dict': {'display_name': 'pnf-servicechain-spine', 'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'id_perms': {'created': '2025-03-20T00:46:31.597691', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:31.597691', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9426741007763986047, 'uuid_mslong': 11374381769213560396}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9dd9ebf4-7da7-464c-82d2-83006561567f'}, 'oper': 'CREATE', 'request-id': 'req-7774c8ac-aa9b-45c0-8153-6ac6bb52b807', 'type': 'role_definition', 'uuid': '9dd9ebf4-7da7-464c-82d2-83006561567f'} 03/20/2025 00:46:31.634 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = http://10.0.0.42:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-servicechain-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-servicechain-leaf"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:31.692 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'obj_dict': {'display_name': 'pnf-servicechain-leaf', 'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'id_perms': {'created': '2025-03-20T00:46:31.677341', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:31.677341', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9403450905476060729, 'uuid_mslong': 15099192496505768240}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd18b1b93-9d78-4930-827f-c4c6e3b9d639'}, 'oper': 'CREATE', 'request-id': 'req-13fbc587-84ee-4d77-bd6d-0e87a0bc8c44', 'type': 'role_definition', 'uuid': 'd18b1b93-9d78-4930-827f-c4c6e3b9d639'} 03/20/2025 00:46:31.766 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf', 'l3-gateway'], 'obj_dict': {'display_name': 'l3-gateway', 'feature_config_additional_params': {'key_value_pair': [{'key': 'use_gateway_ip', 'value': 'True'}]}, 'fq_name': ['default-global-system-config', 'erb-leaf', 'l3-gateway'], 'id_perms': {'created': '2025-03-20T00:46:31.751509', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:31.751509', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10070154354342129819, 'uuid_mslong': 2543224922442123431}}, 'parent_type': 'role-definition', 'parent_uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '234b5997-a615-48a7-8bc0-600803ea709b'}, 'oper': 'CREATE', 'request-id': 'req-d8be8487-6ed1-4082-a2e9-23c973364905', 'type': 'feature_config', 'uuid': '234b5997-a615-48a7-8bc0-600803ea709b'} 03/20/2025 00:46:31.840 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'feature_config_additional_params': {'key_value_pair': [{'key': 'replicator_activation_delay', 'value': '30'}]}, 'fq_name': ['default-global-system-config', 'ar-client-spine', 'assisted-replicator'], 'id_perms': {'created': '2025-03-20T00:46:31.832746', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:31.832746', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9991773776153970450, 'uuid_mslong': 9879331239903839574}}, 'parent_type': 'role-definition', 'parent_uuid': 'c9fce0d0-672c-43f8-a28b-6d126af91fcb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '891a6f6b-74e3-4556-8aa9-e94f8bb88712'}, 'oper': 'CREATE', 'request-id': 'req-77cec973-48de-4250-b80e-30308a4ce17c', 'type': 'feature_config', 'uuid': '891a6f6b-74e3-4556-8aa9-e94f8bb88712'} 03/20/2025 00:46:31.862 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature_config identifier_name = default-global-system-config:ar-client-leaf:assisted-replicator url = http://10.0.0.42:8082/feature-configs operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"feature-config": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client-leaf", "assisted-replicator"], "parent_type": "role-definition", "feature_config_additional_params": {"key_value_pair": [{"key": "replicator_activation_delay", "value": "30"}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "assisted-replicator"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:31.937 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'feature_config_additional_params': {'key_value_pair': [{'key': 'replicator_activation_delay', 'value': '30'}]}, 'fq_name': ['default-global-system-config', 'ar-client-leaf', 'assisted-replicator'], 'id_perms': {'created': '2025-03-20T00:46:31.914256', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:31.914256', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13352193649298502364, 'uuid_mslong': 2278749110917547861}}, 'parent_type': 'role-definition', 'parent_uuid': '4441e96d-2282-4154-a145-b28430c80f2c', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1f9fbe3e-387a-4755-b94c-85618ea9f2dc'}, 'oper': 'CREATE', 'request-id': 'req-ed4b42e2-ff6c-427e-a567-018e6a3e154b', 'type': 'feature_config', 'uuid': '1f9fbe3e-387a-4755-b94c-85618ea9f2dc'} 03/20/2025 00:46:31.984 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'obj_dict': {'display_name': 'juniper-qfx5k-lean', 'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'id_perms': {'created': '2025-03-20T00:46:31.974242', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:31.974242', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13760353580286082866, 'uuid_mslong': 10477296982258764293}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'Route-Reflector']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'}, 'oper': 'CREATE', 'request-id': 'req-69595a46-b2f1-47b3-ab2b-f2ff90fb0c08', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:32.067 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'obj_dict': {'display_name': 'juniper-qfx5k', 'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'id_perms': {'created': '2025-03-20T00:46:32.043170', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.043170', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11932393907345580526, 'uuid_mslong': 4712150110129243900}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4164eb8f-2292-46fc-a598-6109c75e61ee'}, 'oper': 'CREATE', 'request-id': 'req-40b5e454-1f41-4a9b-9bd0-3b1af4ab7d4e', 'type': 'node_profile', 'uuid': '4164eb8f-2292-46fc-a598-6109c75e61ee'} 03/20/2025 00:46:32.112 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k-lean url = http://10.0.0.42:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k-lean"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["Route-Reflector", "AR-Client"]}, {"physical_role": "spine", "rb_roles": ["lean", "Route-Reflector", "AR-Client", "AR-Replicator"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10k-lean"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:32.169 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'obj_dict': {'display_name': 'juniper-qfx10k-lean', 'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'id_perms': {'created': '2025-03-20T00:46:32.160047', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.160047', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9773251859386791612, 'uuid_mslong': 4870209080050599357}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['Route-Reflector', 'AR-Client']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4396755a-d64c-45bd-87a1-90c9032cf6bc'}, 'oper': 'CREATE', 'request-id': 'req-6fb732a0-9f08-4071-806f-7e7b596e6915', 'type': 'node_profile', 'uuid': '4396755a-d64c-45bd-87a1-90c9032cf6bc'} 03/20/2025 00:46:32.235 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'obj_dict': {'display_name': 'juniper-qfx5120', 'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'id_perms': {'created': '2025-03-20T00:46:32.219547', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.219547', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11793885120764863738, 'uuid_mslong': 9277359945958968338}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'Route-Reflector', 'AR-Client', 'ERB-UCAST-Gateway', 'CRB-Gateway', 'PNF-Servicechain']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Gateway', 'Route-Reflector', 'PNF-Servicechain', 'Collapsed-Spine']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '80bfcdb7-a052-4c12-a3ac-4c07d8f464fa'}, 'oper': 'CREATE', 'request-id': 'req-9cf834a0-2641-4ebd-a963-93baedcceb18', 'type': 'node_profile', 'uuid': '80bfcdb7-a052-4c12-a3ac-4c07d8f464fa'} 03/20/2025 00:46:32.300 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'obj_dict': {'display_name': 'juniper-qfx5220', 'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'id_perms': {'created': '2025-03-20T00:46:32.277472', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.277472', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11199331252390629144, 'uuid_mslong': 6134520455082168307}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '552231da-108a-4ff3-9b6c-046ffcac8f18'}, 'oper': 'CREATE', 'request-id': 'req-10086196-5c0a-4a29-84dc-e4f7ddc9b835', 'type': 'node_profile', 'uuid': '552231da-108a-4ff3-9b6c-046ffcac8f18'} 03/20/2025 00:46:32.328 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = http://10.0.0.42:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "ERB-UCAST-Gateway", "DCI-Gateway", "CRB-MCAST-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "CRB-MCAST-Gateway", "DCI-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator", "Collapsed-Spine"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10k"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:32.364 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'obj_dict': {'display_name': 'juniper-qfx10k', 'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'id_perms': {'created': '2025-03-20T00:46:32.356767', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.356767', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10709386041761128897, 'uuid_mslong': 12384687283625935890}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'CRB-MCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator', 'Collapsed-Spine']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'}, 'oper': 'CREATE', 'request-id': 'req-0cbf22e1-5bc7-4f23-89af-39b4e4666375', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 00:46:32.414 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'obj_dict': {'display_name': 'juniper-mx', 'fq_name': ['default-global-system-config', 'juniper-mx'], 'id_perms': {'created': '2025-03-20T00:46:32.402036', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.402036', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11248675088226446468, 'uuid_mslong': 13281750889983397090}}, 'node_profile_device_family': 'junos', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'CRB-MCAST-Gateway']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'}, 'oper': 'CREATE', 'request-id': 'req-45868fb4-6f47-46be-aafd-c5773d170a7e', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:32.429 7fabc218e630 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.47 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:32.438 7fabc2103f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.42 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:32.460 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-86cf233e-9fad-411a-b19d-644e81bf0a99', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 00:46:32.462 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-57edc71a-5c0c-46ca-b5fc-8ef5a2c1cc41', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 00:46:32.481 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'obj_dict': {'display_name': 'juniper-srx', 'fq_name': ['default-global-system-config', 'juniper-srx'], 'id_perms': {'created': '2025-03-20T00:46:32.471703', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.471703', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12902766101527715123, 'uuid_mslong': 14306133896529725794}}, 'node_profile_device_family': 'junos', 'node_profile_hitless_upgrade': False, 'node_profile_roles': {'role_mappings': [{'physical_role': 'pnf', 'rb_roles': ['PNF-Servicechain']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'}, 'oper': 'CREATE', 'request-id': 'req-de3873aa-3393-4594-89d3-2b7670b13a87', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 00:46:32.498 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:device-functional-group url = http://10.0.0.42:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "device-functional-group"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "DCI-Gateway", "ERB-UCAST-Gateway", "CRB-MCAST-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "CRB-MCAST-Gateway", "DCI-Gateway", "ERB-UCAST-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "device-functional-group"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:32.536 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'device-functional-group'], 'obj_dict': {'display_name': 'device-functional-group', 'fq_name': ['default-global-system-config', 'device-functional-group'], 'id_perms': {'created': '2025-03-20T00:46:32.528069', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.528069', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12436544890309580954, 'uuid_mslong': 10140667606089485154}}, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'CRB-MCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8cbae375-ce46-4b62-ac97-7bafa41a189a'}, 'oper': 'CREATE', 'request-id': 'req-61da3130-25b6-4998-b3b5-bd2e3998381d', 'type': 'node_profile', 'uuid': '8cbae375-ce46-4b62-ac97-7bafa41a189a'} 03/20/2025 00:46:32.610 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'obj_dict': {'display_name': 'default-telemetry-profile-1', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'id_perms': {'created': '2025-03-20T00:46:32.602162', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.602162', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12684952656703974144, 'uuid_mslong': 2539459078955026555}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '233df893-e2c1-487b-b00a-013bc77ceb00'}, 'oper': 'CREATE', 'request-id': 'req-8c392c11-be9c-4661-adf0-5aba36e142cd', 'type': 'telemetry_profile', 'uuid': '233df893-e2c1-487b-b00a-013bc77ceb00'} 03/20/2025 00:46:32.667 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'obj_dict': {'display_name': 'default-telemetry-profile-2', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'id_perms': {'created': '2025-03-20T00:46:32.660382', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.660382', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12316051809045605692, 'uuid_mslong': 5839910195570755328}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '510b8761-b72d-4700-aaeb-67ddf9786d3c'}, 'oper': 'CREATE', 'request-id': 'req-40bb8f78-e22a-4ca1-a8c4-1e13800df2ce', 'type': 'telemetry_profile', 'uuid': '510b8761-b72d-4700-aaeb-67ddf9786d3c'} 03/20/2025 00:46:32.703 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-3 url = http://10.0.0.42:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-3"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-3"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:32.740 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'obj_dict': {'display_name': 'default-telemetry-profile-3', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'id_perms': {'created': '2025-03-20T00:46:32.726277', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.726277', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11964996148013433181, 'uuid_mslong': 4875879674253036873}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '43aa9aba-ef66-4d49-a60c-349a7542015d'}, 'oper': 'CREATE', 'request-id': 'req-6eec6e27-67bf-41e9-9b52-0eae90aba3e1', 'type': 'telemetry_profile', 'uuid': '43aa9aba-ef66-4d49-a60c-349a7542015d'} 03/20/2025 00:46:32.806 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'obj_dict': {'display_name': 'default-telemetry-profile-4', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'id_perms': {'created': '2025-03-20T00:46:32.793047', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.793047', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10674318520106310793, 'uuid_mslong': 9744023055968846978}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '8739b957-e63d-4482-9422-cc239a4f5c89'}, 'oper': 'CREATE', 'request-id': 'req-7b239885-14a9-4e9e-8c2d-089c0fa49e1c', 'type': 'telemetry_profile', 'uuid': '8739b957-e63d-4482-9422-cc239a4f5c89'} 03/20/2025 00:46:32.852 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'obj_dict': {'display_name': 'default-telemetry-profile-5', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'id_perms': {'created': '2025-03-20T00:46:32.845642', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.845642', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9907127085189317706, 'uuid_mslong': 10702150087580271005}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '9485accd-5f23-419d-897d-2f98015c444a'}, 'oper': 'CREATE', 'request-id': 'req-2e9f5d11-7d3e-440d-b01b-c26727752f00', 'type': 'telemetry_profile', 'uuid': '9485accd-5f23-419d-897d-2f98015c444a'} 03/20/2025 00:46:32.881 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-6 url = http://10.0.0.42:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-6"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-6"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:32.917 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'obj_dict': {'display_name': 'default-telemetry-profile-6', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'id_perms': {'created': '2025-03-20T00:46:32.911018', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.911018', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13279607985894438658, 'uuid_mslong': 17515194012358822120}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': 'f3127827-9eb2-48e8-b84a-a51ad3adb702'}, 'oper': 'CREATE', 'request-id': 'req-1324f25a-af3b-46c6-a3c7-4cde78e0b63b', 'type': 'telemetry_profile', 'uuid': 'f3127827-9eb2-48e8-b84a-a51ad3adb702'} 03/20/2025 00:46:32.973 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-all-interfaces'], 'obj_dict': {'display_name': 'sflow-all-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-all-interfaces'], 'id_perms': {'created': '2025-03-20T00:46:32.960766', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:32.960766', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10060118613372770207, 'uuid_mslong': 11607217529492687344}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'all', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': 'a1151ed8-6c19-49f0-8b9c-b893fc61179f'}, 'oper': 'CREATE', 'request-id': 'req-9d24593f-4867-4434-8bd0-7631954dfefa', 'type': 'sflow_profile', 'uuid': 'a1151ed8-6c19-49f0-8b9c-b893fc61179f'} 03/20/2025 00:46:33.020 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-fabric-interfaces'], 'obj_dict': {'display_name': 'sflow-fabric-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-fabric-interfaces'], 'id_perms': {'created': '2025-03-20T00:46:33.012117', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.012117', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9460469092796421151, 'uuid_mslong': 18355977100281792430}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'fabric', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': 'febd87eb-2780-47ae-834a-568424b1541f'}, 'oper': 'CREATE', 'request-id': 'req-67698f5b-b06d-4346-a7f6-dd482968819d', 'type': 'sflow_profile', 'uuid': 'febd87eb-2780-47ae-834a-568424b1541f'} 03/20/2025 00:46:33.037 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = sflow_profile identifier_name = default-domain:default-project:sflow-access-interfaces url = http://10.0.0.42:8082/sflow-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"sflow-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "sflow-access-interfaces"], "parent_type": "project", "sflow_profile_is_default": true, "sflow_parameters": {"stats_collection_frequency": {"sample_rate": 2000, "polling_interval": 0, "direction": null}, "agent_id": null, "adaptive_sample_rate": 300, "enabled_interface_type": "access", "enabled_interface_params": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "sflow-access-interfaces"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:33.062 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-access-interfaces'], 'obj_dict': {'display_name': 'sflow-access-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-access-interfaces'], 'id_perms': {'created': '2025-03-20T00:46:33.056457', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.056457', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9224263860488577990, 'uuid_mslong': 11812845970090116019}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'access', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': 'a3efa8d2-99a0-43b3-8003-2b1bdee523c6'}, 'oper': 'CREATE', 'request-id': 'req-53d07fdd-12de-4343-bd0d-9ecb7f8b7ca0', 'type': 'sflow_profile', 'uuid': 'a3efa8d2-99a0-43b3-8003-2b1bdee523c6'} 03/20/2025 00:46:33.122 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'grpc-default-profile'], 'obj_dict': {'display_name': 'grpc-default-profile', 'fq_name': ['default-domain', 'default-project', 'grpc-default-profile'], 'grpc_parameters': {'allow_clients': {'subnet': [{'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}]}, 'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}, 'secure_mode': None}, 'grpc_profile_is_default': True, 'id_perms': {'created': '2025-03-20T00:46:33.112614', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.112614', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9906140539731979083, 'uuid_mslong': 4296103598438633444}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3b9ed376-0736-4fe4-8979-ae55fdd22b4b'}, 'oper': 'CREATE', 'request-id': 'req-b650a12c-b680-4216-868b-3bba7499ad6c', 'type': 'grpc_profile', 'uuid': '3b9ed376-0736-4fe4-8979-ae55fdd22b4b'} 03/20/2025 00:46:33.175 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'snmp-default-profile'], 'obj_dict': {'display_name': 'snmp-default-profile', 'fq_name': ['default-domain', 'default-project', 'snmp-default-profile'], 'id_perms': {'created': '2025-03-20T00:46:33.167868', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.167868', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11887968999860831620, 'uuid_mslong': 6653732003352103450}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'snmp_parameters': {'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}}, 'snmp_profile_is_default': True, 'uuid': '5c56ce01-0a73-4a1a-a4fa-8cd1f98f8584'}, 'oper': 'CREATE', 'request-id': 'req-5a3ff652-5bb0-4dd0-a334-2e502f291373', 'type': 'snmp_profile', 'uuid': '5c56ce01-0a73-4a1a-a4fa-8cd1f98f8584'} 03/20/2025 00:46:33.193 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = netconf_profile identifier_name = default-domain:default-project:netconf-default-profile url = http://10.0.0.42:8082/netconf-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"netconf-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "netconf-default-profile"], "parent_type": "project", "netconf_profile_is_default": true, "netconf_parameters": {"enabled_sensor_params": {"physical_health": true, "interface_health": true, "control_plane_health": true, "service_layer_health": true}}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "netconf-default-profile"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:33.224 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'netconf-default-profile'], 'obj_dict': {'display_name': 'netconf-default-profile', 'fq_name': ['default-domain', 'default-project', 'netconf-default-profile'], 'id_perms': {'created': '2025-03-20T00:46:33.217840', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.217840', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12772959804741307767, 'uuid_mslong': 7972974933769013190}}, 'netconf_parameters': {'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}}, 'netconf_profile_is_default': True, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6ea5b275-aa65-47c6-b142-ab44b3f2cd77'}, 'oper': 'CREATE', 'request-id': 'req-7336f3ff-95bc-49c3-afa0-d2f6edb59083', 'type': 'netconf_profile', 'uuid': '6ea5b275-aa65-47c6-b142-ab44b3f2cd77'} 03/20/2025 00:46:33.283 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L2 servers ' 'connectivity with ' 'ingress replication for ' 'multicast in the spine', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['CRB-Access', 'AR-Client']}, 'display_name': 'L2-Server-Leaf', 'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'id_perms': {'created': '2025-03-20T00:46:33.275577', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.275577', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10846443101750418185, 'uuid_mslong': 18231681188103143587}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fd03f171-eb0f-40a3-9686-4e88bc51db09'}, 'oper': 'CREATE', 'request-id': 'req-0addbbd0-6438-446e-9d83-97a737733335', 'type': 'device_functional_group', 'uuid': 'fd03f171-eb0f-40a3-9686-4e88bc51db09'} 03/20/2025 00:46:33.336 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L3 servers ' 'connectivity', 'device_functional_group_os_version': '19.1R3', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway']}, 'display_name': 'L3-Server-Leaf', 'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'id_perms': {'created': '2025-03-20T00:46:33.328143', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.328143', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9818100290783662685, 'uuid_mslong': 236740495334919243}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '03491239-e863-4c4b-8840-e6322951d25d'}, 'oper': 'CREATE', 'request-id': 'req-508dc917-15ef-4bb5-919d-d9f1af51521e', 'type': 'device_functional_group', 'uuid': '03491239-e863-4c4b-8840-e6322951d25d'} 03/20/2025 00:46:33.369 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Gateway-Spine url = http://10.0.0.42:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Gateway-Spine"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway connectivity at spines", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["CRB-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Gateway-Spine"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:33.393 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'connectivity at spines', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['CRB-Gateway']}, 'display_name': 'L3-Gateway-Spine', 'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'id_perms': {'created': '2025-03-20T00:46:33.387131', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.387131', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13581938200247069358, 'uuid_mslong': 1544688737056475084}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '156fd638-e4cc-47cc-bc7c-bcd53b08eaae'}, 'oper': 'CREATE', 'request-id': 'req-7e6dac87-f4e2-4b70-a1f6-9702da3753a4', 'type': 'device_functional_group', 'uuid': '156fd638-e4cc-47cc-bc7c-bcd53b08eaae'} 03/20/2025 00:46:33.435 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L3 connectivity ' 'to storage arrays', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway']}, 'display_name': 'L3-Storage-Leaf', 'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'id_perms': {'created': '2025-03-20T00:46:33.427099', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.427099', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13662966389210178001, 'uuid_mslong': 2509092398784006986}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '22d2163e-3227-4b4a-bd9c-9b8a9ef961d1'}, 'oper': 'CREATE', 'request-id': 'req-a8c40b27-9e76-43ee-9bbb-22942c62d17c', 'type': 'device_functional_group', 'uuid': '22d2163e-3227-4b4a-bd9c-9b8a9ef961d1'} 03/20/2025 00:46:33.483 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'obj_dict': {'device_functional_group_description': 'Provides L3 servers ' 'connectivity with ' 'Optimized multicast ' 'traffic', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway', 'AR-Client']}, 'display_name': 'L3-Server-Leaf-with-Optimized-Multicast', 'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'id_perms': {'created': '2025-03-20T00:46:33.476474', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.476474', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9420860501222139083, 'uuid_mslong': 1508726790838307577}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '14f01305-cf08-4af9-82bd-9eb645daa4cb'}, 'oper': 'CREATE', 'request-id': 'req-e5b463f6-c8c1-4f41-98de-57a9e3819467', 'type': 'device_functional_group', 'uuid': '14f01305-cf08-4af9-82bd-9eb645daa4cb'} 03/20/2025 00:46:33.498 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine url = http://10.0.0.42:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Centrally-Routed-Border-Spine"], "parent_type": "project", "device_functional_group_description": "Provides L3 routing for L2 server leafs and route reflector and ingress replication, as well DCGW and DCI GW and connectivity to firewalls", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "CRB-Gateway", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Centrally-Routed-Border-Spine"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:33.537 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'obj_dict': {'device_functional_group_description': 'Provides L3 routing ' 'for L2 server leafs and ' 'route reflector and ' 'ingress replication, as ' 'well DCGW and DCI GW and ' 'connectivity to ' 'firewalls', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'CRB-Gateway', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain']}, 'display_name': 'Centrally-Routed-Border-Spine', 'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'id_perms': {'created': '2025-03-20T00:46:33.525228', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.525228', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13825375779032004346, 'uuid_mslong': 14021910566107956899}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c297d55e-5d29-46a3-bfdd-9a05637df6fa'}, 'oper': 'CREATE', 'request-id': 'req-5c09330d-d253-4d69-9961-236f8539c446', 'type': 'device_functional_group', 'uuid': 'c297d55e-5d29-46a3-bfdd-9a05637df6fa'} 03/20/2025 00:46:33.568 7fabc2298588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/global-system-config/92e769a6-5754-45f5-bd68-145125efbf0e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"global-system-config": {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:33.577 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'obj_dict': {'device_functional_group_description': 'Provides L3 routing and ' 'gateway services for L2 ' 'server leafs ; provides ' 'route reflector and ' 'assisted replication', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'AR-Replicator', 'CRB-Gateway', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain']}, 'display_name': 'Centrally-Routed-Border-Spine-With-Optimized-Multicast', 'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'id_perms': {'created': '2025-03-20T00:46:33.567187', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.567187', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13029442514768454342, 'uuid_mslong': 1696315435045898125}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '178a85e6-94ec-478d-b4d1-e0ef2a2562c6'}, 'oper': 'CREATE', 'request-id': 'req-d18916c0-6e93-42ba-b763-98840b411f94', 'type': 'device_functional_group', 'uuid': '178a85e6-94ec-478d-b4d1-e0ef2a2562c6'} 03/20/2025 00:46:33.606 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-483606b8-3d62-4da4-a057-0c5e85eae2a9', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 00:46:33.617 7fabc22bca20 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/global-system-config/92e769a6-5754-45f5-bd68-145125efbf0e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.42 body = {"global-system-config": {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:33.644 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'services, route ' 'reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'CRB-MCAST-Gateway']}, 'display_name': 'Border-Spine-in-Edge-Routed', 'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'id_perms': {'created': '2025-03-20T00:46:33.623945', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.623945', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10422123546840236947, 'uuid_mslong': 13863679981299191291}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c065af7d-7508-4dfb-90a2-d225a6a58393'}, 'oper': 'CREATE', 'request-id': 'req-5623cbfa-fad1-4573-92d8-a295c9acc16c', 'type': 'device_functional_group', 'uuid': 'c065af7d-7508-4dfb-90a2-d225a6a58393'} 03/20/2025 00:46:33.669 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Border-Leaf-in-Edge-Routed url = http://10.0.0.42:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Border-Leaf-in-Edge-Routed"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway services, route reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain", "CRB-MCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Border-Leaf-in-Edge-Routed"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:33.681 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-ca13c1ba-794e-4781-9041-eb2fa8dd7f62', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 00:46:33.735 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'services, route ' 'reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'CRB-MCAST-Gateway']}, 'display_name': 'Border-Leaf-in-Edge-Routed', 'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'id_perms': {'created': '2025-03-20T00:46:33.726742', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.726742', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9340945025054094068, 'uuid_mslong': 16124855795815958377}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dfc6fee9-c402-4769-81a1-b40284cd32f4'}, 'oper': 'CREATE', 'request-id': 'req-a728ff41-f012-492e-b459-06fa6285fb62', 'type': 'device_functional_group', 'uuid': 'dfc6fee9-c402-4769-81a1-b40284cd32f4'} 03/20/2025 00:46:33.830 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'obj_dict': {'device_functional_group_description': 'Spine only acting as ' 'Route Reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'lean']}, 'display_name': 'Lean-Spine-with-Route-Reflector', 'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'id_perms': {'created': '2025-03-20T00:46:33.820824', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.820824', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10254125336361402313, 'uuid_mslong': 10276906343415369079}}, 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8e9ee7de-b53b-4d77-8e4d-f8aa2c277fc9'}, 'oper': 'CREATE', 'request-id': 'req-a85a8dd1-ec5c-4a65-b6b5-b71d48892b49', 'type': 'device_functional_group', 'uuid': '8e9ee7de-b53b-4d77-8e4d-f8aa2c277fc9'} 03/20/2025 00:46:33.880 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean', 'basic'], 'id_perms': {'created': '2025-03-20T00:46:33.873489', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.873489', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9275333548513802489, 'uuid_mslong': 1214123832024058980}}, 'parent_type': 'node-profile', 'parent_uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '10d96f31-4921-4c64-80b8-9ab8346db8f9'}, 'oper': 'CREATE', 'request-id': 'req-2766c5cf-7a4e-4370-b238-a13dcf29264c', 'type': 'role_config', 'uuid': '10d96f31-4921-4c64-80b8-9ab8346db8f9'} 03/20/2025 00:46:33.900 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5k:basic url = http://10.0.0.42:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:33.931 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5k', 'basic'], 'id_perms': {'created': '2025-03-20T00:46:33.919223', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.919223', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13573330379487755223, 'uuid_mslong': 9363664751633975401}}, 'parent_type': 'node-profile', 'parent_uuid': '4164eb8f-2292-46fc-a598-6109c75e61ee', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '81f26b7b-14fd-4869-bc5e-2810c862bbd7'}, 'oper': 'CREATE', 'request-id': 'req-7cad1d7a-5cfb-4713-ba65-d5d895a2038e', 'type': 'role_config', 'uuid': '81f26b7b-14fd-4869-bc5e-2810c862bbd7'} 03/20/2025 00:46:33.979 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5120', 'basic'], 'id_perms': {'created': '2025-03-20T00:46:33.971032', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:33.971032', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11040937443764916641, 'uuid_mslong': 193935339638968069}}, 'parent_type': 'node-profile', 'parent_uuid': '80bfcdb7-a052-4c12-a3ac-4c07d8f464fa', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '02b0ff29-f493-4f05-9939-4a1b92ead1a1'}, 'oper': 'CREATE', 'request-id': 'req-0dfef55a-0ee5-403d-a063-69f64dd7a5ab', 'type': 'role_config', 'uuid': '02b0ff29-f493-4f05-9939-4a1b92ead1a1'} 03/20/2025 00:46:34.027 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5220', 'basic'], 'id_perms': {'created': '2025-03-20T00:46:34.017987', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:34.017987', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12176378935410003423, 'uuid_mslong': 1897871238191399664}}, 'parent_type': 'node-profile', 'parent_uuid': '552231da-108a-4ff3-9b6c-046ffcac8f18', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '1a5697d5-f5d4-42f0-a8fb-3020e7a98ddf'}, 'oper': 'CREATE', 'request-id': 'req-9aae32ab-7ffa-4b86-9a17-ef073d0e6495', 'type': 'role_config', 'uuid': '1a5697d5-f5d4-42f0-a8fb-3020e7a98ddf'} 03/20/2025 00:46:34.046 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx10k-lean:basic url = http://10.0.0.42:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k-lean", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:34.078 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean', 'basic'], 'id_perms': {'created': '2025-03-20T00:46:34.072044', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:34.072044', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12741890325189128519, 'uuid_mslong': 2132690799959952731}}, 'parent_type': 'node-profile', 'parent_uuid': '4396755a-d64c-45bd-87a1-90c9032cf6bc', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '1d98d6fb-ab5b-4d5b-b0d4-49bdc7e27147'}, 'oper': 'CREATE', 'request-id': 'req-bd7c6c19-3d10-4219-8406-a515b87a06b0', 'type': 'role_config', 'uuid': '1d98d6fb-ab5b-4d5b-b0d4-49bdc7e27147'} 03/20/2025 00:46:34.131 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx10k', 'basic'], 'id_perms': {'created': '2025-03-20T00:46:34.123256', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:34.123256', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9863371824838402922, 'uuid_mslong': 14954420126683383774}}, 'parent_type': 'node-profile', 'parent_uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': 'cf88c5df-90ea-47de-88e1-bc6a9316e36a'}, 'oper': 'CREATE', 'request-id': 'req-703a67d9-90c3-4f5e-8951-432e4d8521f0', 'type': 'role_config', 'uuid': 'cf88c5df-90ea-47de-88e1-bc6a9316e36a'} 03/20/2025 00:46:34.180 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-mx', 'basic'], 'id_perms': {'created': '2025-03-20T00:46:34.174477', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:34.174477', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12845637490579199936, 'uuid_mslong': 14571110943344184734}}, 'parent_type': 'node-profile', 'parent_uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': 'ca36fc33-b0d6-4d9e-b244-df3d1369d7c0'}, 'oper': 'CREATE', 'request-id': 'req-48454521-0683-4139-991f-d0b308f9a79e', 'type': 'role_config', 'uuid': 'ca36fc33-b0d6-4d9e-b244-df3d1369d7c0'} 03/20/2025 00:46:34.196 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-srx:basic url = http://10.0.0.42:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-srx", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:34.224 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-srx', 'basic'], 'id_perms': {'created': '2025-03-20T00:46:34.217176', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:34.217176', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12878438610652378816, 'uuid_mslong': 14931474315844931365}}, 'parent_type': 'node-profile', 'parent_uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': 'cf3740c7-a8ce-4f25-b2b9-67aef99c36c0'}, 'oper': 'CREATE', 'request-id': 'req-f79af513-69a9-47f0-bed8-911c9fe7a976', 'type': 'role_config', 'uuid': 'cf3740c7-a8ce-4f25-b2b9-67aef99c36c0'} 03/20/2025 00:46:34.247 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fad1e96f-8862-4fab-bb10-aa63d51ee561 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "fad1e96f-8862-4fab-bb10-aa63d51ee561", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:34.267 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c93ccb09-5afe-48a2-803a-8d3131e1460c', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 00:46:34.331 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fad1e96f-8862-4fab-bb10-aa63d51ee561 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "fad1e96f-8862-4fab-bb10-aa63d51ee561", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:34.343 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3404203e-b4f9-4c1d-b56a-adbbc2ed8a7e', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 00:46:34.407 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fad1e96f-8862-4fab-bb10-aa63d51ee561 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "fad1e96f-8862-4fab-bb10-aa63d51ee561", "ref-type": "feature", "ref-uuid": "420834eb-f3b0-440d-bc7a-9e97ce8b4758", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:34.419 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0bcf3261-b931-40ac-8ae6-d734dbafb94a', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 00:46:34.484 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fad1e96f-8862-4fab-bb10-aa63d51ee561 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "fad1e96f-8862-4fab-bb10-aa63d51ee561", "ref-type": "feature", "ref-uuid": "112418ab-2ad1-4403-92b9-7f47c3c0e4ea", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:34.497 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-78e6481a-f78f-498b-a6b0-3e6d917c8276', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 00:46:34.559 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fad1e96f-8862-4fab-bb10-aa63d51ee561 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "fad1e96f-8862-4fab-bb10-aa63d51ee561", "ref-type": "feature", "ref-uuid": "f1377070-38f1-44f6-ae3e-c48ddac79ba2", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:34.573 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-10c1e760-0d66-479e-808c-658bac861355', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 00:46:34.636 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fad1e96f-8862-4fab-bb10-aa63d51ee561 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "fad1e96f-8862-4fab-bb10-aa63d51ee561", "ref-type": "feature", "ref-uuid": "7cfd1d6a-cfde-4f81-9f77-520d8227364c", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:34.651 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a7c5384f-90f8-4598-a1bd-87f73b0c67ff', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 00:46:34.715 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fad1e96f-8862-4fab-bb10-aa63d51ee561 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "fad1e96f-8862-4fab-bb10-aa63d51ee561", "ref-type": "feature", "ref-uuid": "4c647a97-0e6e-41fb-9220-b4fa5b91a202", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:34.729 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d96eb573-432e-4dcf-88cc-803840daea44', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 00:46:34.749 7fabc202deb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:34.751 7fabc202deb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:34.751 7fabc202deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:34.751 7fabc202deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:34.751 7fabc202deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:34.751 7fabc202deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:34.752 7fabc202deb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:34.752 7fabc202deb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:34.752 7fabc202deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:34.752 7fabc202deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:34.752 7fabc202deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:34.752 7fabc202deb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:34.752 7fabc202deb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:46:34.752 7fabc202deb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:34.793 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fad1e96f-8862-4fab-bb10-aa63d51ee561 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "fad1e96f-8862-4fab-bb10-aa63d51ee561", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:34.808 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-15c17f67-0f05-4ac7-a84c-749fc61cd890', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 00:46:34.870 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fad1e96f-8862-4fab-bb10-aa63d51ee561 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "fad1e96f-8862-4fab-bb10-aa63d51ee561", "ref-type": "physical-role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:34.882 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0012677a-4aa6-42d0-9d00-4e0caad25a76', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 00:46:34.948 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fad1e96f-8862-4fab-bb10-aa63d51ee561 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "fad1e96f-8862-4fab-bb10-aa63d51ee561", "ref-type": "overlay-role", "ref-uuid": "e9736b6f-74c6-458f-a2b2-72bc117db9bb", "ref-fq-name": ["default-global-system-config", "erb-ucast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:34.961 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-557a9a2f-694c-4e2d-8f56-f20170439d21', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 00:46:35.021 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29c66905-1418-4dd7-8013-34e78036e6ce object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29c66905-1418-4dd7-8013-34e78036e6ce", "ref-type": "feature", "ref-uuid": "4c647a97-0e6e-41fb-9220-b4fa5b91a202", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:35.036 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d211fc8b-9dac-4171-8e7b-bd18d1714c2e', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 00:46:35.100 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29c66905-1418-4dd7-8013-34e78036e6ce object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29c66905-1418-4dd7-8013-34e78036e6ce", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:35.117 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-bdd32d7d-739c-4847-badb-e9f42e0375a5', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 00:46:35.177 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29c66905-1418-4dd7-8013-34e78036e6ce object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29c66905-1418-4dd7-8013-34e78036e6ce", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:35.193 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-918c091f-41d1-4dd9-9aff-a1d34f409de6', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 00:46:35.254 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29c66905-1418-4dd7-8013-34e78036e6ce object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29c66905-1418-4dd7-8013-34e78036e6ce", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:35.275 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ddb08666-23c7-4499-ad23-ee30c3d25008', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 00:46:35.338 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29c66905-1418-4dd7-8013-34e78036e6ce object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29c66905-1418-4dd7-8013-34e78036e6ce", "ref-type": "feature", "ref-uuid": "420834eb-f3b0-440d-bc7a-9e97ce8b4758", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:35.357 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5720b429-50b9-4f58-89e4-674a0cf6dc4d', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 00:46:35.420 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29c66905-1418-4dd7-8013-34e78036e6ce object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29c66905-1418-4dd7-8013-34e78036e6ce", "ref-type": "feature", "ref-uuid": "112418ab-2ad1-4403-92b9-7f47c3c0e4ea", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:35.439 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f92331a0-5065-42bb-8bce-ec07213c2be2', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 00:46:35.506 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29c66905-1418-4dd7-8013-34e78036e6ce object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29c66905-1418-4dd7-8013-34e78036e6ce", "ref-type": "physical-role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:35.525 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a02abf38-bfaa-4aac-9543-1fb2d629a0ab', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 00:46:35.590 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29c66905-1418-4dd7-8013-34e78036e6ce object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29c66905-1418-4dd7-8013-34e78036e6ce", "ref-type": "overlay-role", "ref-uuid": "c22d4b0f-be2c-48cd-aac0-249437277343", "ref-fq-name": ["default-global-system-config", "crb-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:35.624 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e96c37ed-8493-402d-9211-5f24e2acab0c', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 00:46:35.686 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c566ae8-75e7-4e69-81a7-d2c2c52fd0be object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c566ae8-75e7-4e69-81a7-d2c2c52fd0be", "ref-type": "feature", "ref-uuid": "4c647a97-0e6e-41fb-9220-b4fa5b91a202", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:35.705 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-65b48f25-0069-40e7-84aa-d5530115af78', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 00:46:35.765 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c566ae8-75e7-4e69-81a7-d2c2c52fd0be object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c566ae8-75e7-4e69-81a7-d2c2c52fd0be", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:35.779 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-f6e25348-ba1c-4153-8ea9-54bd9ccd01da', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 00:46:35.841 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c566ae8-75e7-4e69-81a7-d2c2c52fd0be object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c566ae8-75e7-4e69-81a7-d2c2c52fd0be", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:35.856 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-ce4fcd09-1fb6-450b-9ce9-b113d783db16', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 00:46:35.916 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c566ae8-75e7-4e69-81a7-d2c2c52fd0be object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c566ae8-75e7-4e69-81a7-d2c2c52fd0be", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:35.933 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-3c6291d5-c456-47bd-bcb1-6b239d58514d', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 00:46:35.993 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c566ae8-75e7-4e69-81a7-d2c2c52fd0be object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c566ae8-75e7-4e69-81a7-d2c2c52fd0be", "ref-type": "feature", "ref-uuid": "420834eb-f3b0-440d-bc7a-9e97ce8b4758", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:36.006 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-351ac350-8260-4b42-9ddb-4c29f9493fb0', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 00:46:36.069 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c566ae8-75e7-4e69-81a7-d2c2c52fd0be object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c566ae8-75e7-4e69-81a7-d2c2c52fd0be", "ref-type": "feature", "ref-uuid": "112418ab-2ad1-4403-92b9-7f47c3c0e4ea", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:36.081 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-dd748db3-d414-4885-919f-80f7e1dc5860', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 00:46:36.147 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c566ae8-75e7-4e69-81a7-d2c2c52fd0be object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c566ae8-75e7-4e69-81a7-d2c2c52fd0be", "ref-type": "physical-role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:36.159 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-bfe31a48-06d5-4de8-8f0b-4bba88d1e173', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 00:46:36.224 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c566ae8-75e7-4e69-81a7-d2c2c52fd0be object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c566ae8-75e7-4e69-81a7-d2c2c52fd0be", "ref-type": "overlay-role", "ref-uuid": "c22d4b0f-be2c-48cd-aac0-249437277343", "ref-fq-name": ["default-global-system-config", "crb-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:36.238 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-5d29db7a-247c-4271-8b9e-f63140ecd68f', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 00:46:36.307 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbdee73d-ee96-4741-80b8-6787a2819670 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbdee73d-ee96-4741-80b8-6787a2819670", "ref-type": "feature", "ref-uuid": "f1377070-38f1-44f6-ae3e-c48ddac79ba2", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:36.323 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-3917669e-f39d-488e-84c5-f865235799da', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 00:46:36.385 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbdee73d-ee96-4741-80b8-6787a2819670 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbdee73d-ee96-4741-80b8-6787a2819670", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:36.400 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-891ca45a-4920-4ad6-aed1-61b43479ebde', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 00:46:36.463 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbdee73d-ee96-4741-80b8-6787a2819670 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbdee73d-ee96-4741-80b8-6787a2819670", "ref-type": "feature", "ref-uuid": "7cfd1d6a-cfde-4f81-9f77-520d8227364c", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:36.485 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-c8a8c3e3-5f52-42bf-9642-5ee6bff3fc21', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 00:46:36.551 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbdee73d-ee96-4741-80b8-6787a2819670 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbdee73d-ee96-4741-80b8-6787a2819670", "ref-type": "feature", "ref-uuid": "4c647a97-0e6e-41fb-9220-b4fa5b91a202", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:36.570 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-cc03ab5c-80b2-4ad4-8dca-4e022e72788f', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 00:46:36.636 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbdee73d-ee96-4741-80b8-6787a2819670 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbdee73d-ee96-4741-80b8-6787a2819670", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:36.649 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-06f4fa38-fffa-47ca-b653-9a1f0e90b64b', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 00:46:36.716 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbdee73d-ee96-4741-80b8-6787a2819670 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbdee73d-ee96-4741-80b8-6787a2819670", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:36.728 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-75c5f1ce-c502-491e-afc6-b1a058657b8f', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 00:46:36.793 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbdee73d-ee96-4741-80b8-6787a2819670 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbdee73d-ee96-4741-80b8-6787a2819670", "ref-type": "overlay-role", "ref-uuid": "e663ef65-4088-44c5-9eb2-47a9eb3f61e0", "ref-fq-name": ["default-global-system-config", "crb-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:36.811 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-c12c601d-bef3-459b-a67e-c2c3bc63b49c', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 00:46:36.875 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbdee73d-ee96-4741-80b8-6787a2819670 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbdee73d-ee96-4741-80b8-6787a2819670", "ref-type": "physical-role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:36.887 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-c4233eb8-9525-440f-a677-f306e73c1a71', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 00:46:36.953 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e21727ee-f7c6-47ab-b972-cc324d2970e4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "e21727ee-f7c6-47ab-b972-cc324d2970e4", "ref-type": "feature", "ref-uuid": "f1377070-38f1-44f6-ae3e-c48ddac79ba2", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:36.970 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6bb030bd-eae7-4af3-933f-8f892d4a24ef', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 00:46:37.034 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e21727ee-f7c6-47ab-b972-cc324d2970e4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "e21727ee-f7c6-47ab-b972-cc324d2970e4", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:37.051 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-9459946a-e189-4aad-9885-c58ae5ba5fc5', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 00:46:37.117 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e21727ee-f7c6-47ab-b972-cc324d2970e4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "e21727ee-f7c6-47ab-b972-cc324d2970e4", "ref-type": "feature", "ref-uuid": "7cfd1d6a-cfde-4f81-9f77-520d8227364c", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:37.138 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6a2cedd0-b4da-473d-943b-0dadebb07e77', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 00:46:37.199 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e21727ee-f7c6-47ab-b972-cc324d2970e4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "e21727ee-f7c6-47ab-b972-cc324d2970e4", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:37.217 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-58654566-4caa-49cb-876b-b63d5006b967', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 00:46:37.278 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e21727ee-f7c6-47ab-b972-cc324d2970e4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "e21727ee-f7c6-47ab-b972-cc324d2970e4", "ref-type": "feature", "ref-uuid": "4c647a97-0e6e-41fb-9220-b4fa5b91a202", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:37.306 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7788e612-2f80-45f8-b712-065771ad7e86', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 00:46:37.376 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e21727ee-f7c6-47ab-b972-cc324d2970e4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "e21727ee-f7c6-47ab-b972-cc324d2970e4", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:37.391 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e9c82d06-e3b2-412c-9c67-47f65ede55bd', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 00:46:37.451 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e21727ee-f7c6-47ab-b972-cc324d2970e4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "e21727ee-f7c6-47ab-b972-cc324d2970e4", "ref-type": "overlay-role", "ref-uuid": "e663ef65-4088-44c5-9eb2-47a9eb3f61e0", "ref-fq-name": ["default-global-system-config", "crb-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:37.465 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ded96fc6-5d59-4a6e-a211-df649ecbe2e0', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 00:46:37.527 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e21727ee-f7c6-47ab-b972-cc324d2970e4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "e21727ee-f7c6-47ab-b972-cc324d2970e4", "ref-type": "physical-role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:37.540 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ee111750-95db-4ab8-b50d-c2024dd38ac0', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 00:46:37.600 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29269d01-b04e-44db-9eee-019d549f7157 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29269d01-b04e-44db-9eee-019d549f7157", "ref-type": "feature", "ref-uuid": "f1377070-38f1-44f6-ae3e-c48ddac79ba2", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:37.614 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-94b8d83a-fba7-4341-829d-e601786088b3', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 00:46:37.679 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29269d01-b04e-44db-9eee-019d549f7157 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29269d01-b04e-44db-9eee-019d549f7157", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:37.693 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-0654d6ce-f28a-4c43-b79e-af4f83b7640d', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 00:46:37.757 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29269d01-b04e-44db-9eee-019d549f7157 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29269d01-b04e-44db-9eee-019d549f7157", "ref-type": "feature", "ref-uuid": "7cfd1d6a-cfde-4f81-9f77-520d8227364c", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:37.769 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-0a3ca1bd-65da-4045-a226-2d056e45320d', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 00:46:37.831 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29269d01-b04e-44db-9eee-019d549f7157 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29269d01-b04e-44db-9eee-019d549f7157", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:37.846 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-69034669-bc03-4461-988f-6ed5ca89a363', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 00:46:37.909 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29269d01-b04e-44db-9eee-019d549f7157 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29269d01-b04e-44db-9eee-019d549f7157", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:37.924 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-a8cb265e-2847-4bff-aa68-49624be9c37b', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 00:46:37.996 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29269d01-b04e-44db-9eee-019d549f7157 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29269d01-b04e-44db-9eee-019d549f7157", "ref-type": "overlay-role", "ref-uuid": "25900aa8-37cf-4f71-94cc-fa821f26527b", "ref-fq-name": ["default-global-system-config", "crb-mcast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:38.016 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-eb662b1d-e516-4896-829a-bcbf2a688d72', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 00:46:38.076 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29269d01-b04e-44db-9eee-019d549f7157 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29269d01-b04e-44db-9eee-019d549f7157", "ref-type": "physical-role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:38.091 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-eb795781-6299-4217-989f-6c5d3efe4aba', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 00:46:38.151 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c4d1624b-5ac2-4659-8cb9-9939ec42b8ea object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c4d1624b-5ac2-4659-8cb9-9939ec42b8ea", "ref-type": "feature", "ref-uuid": "f1377070-38f1-44f6-ae3e-c48ddac79ba2", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:38.167 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e6a34c2e-feeb-429b-ac27-091a3b881b95', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 00:46:38.232 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c4d1624b-5ac2-4659-8cb9-9939ec42b8ea object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c4d1624b-5ac2-4659-8cb9-9939ec42b8ea", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:38.245 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-bb5521e7-d5ff-4da4-882b-bdd883d23dc4', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 00:46:38.307 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c4d1624b-5ac2-4659-8cb9-9939ec42b8ea object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c4d1624b-5ac2-4659-8cb9-9939ec42b8ea", "ref-type": "feature", "ref-uuid": "7cfd1d6a-cfde-4f81-9f77-520d8227364c", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:38.319 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4e237228-ce29-4196-978d-4c1eb23447a3', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 00:46:38.380 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c4d1624b-5ac2-4659-8cb9-9939ec42b8ea object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c4d1624b-5ac2-4659-8cb9-9939ec42b8ea", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:38.393 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e39be44b-3754-4ec3-aae7-3eea59eda4e5', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 00:46:38.458 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c4d1624b-5ac2-4659-8cb9-9939ec42b8ea object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c4d1624b-5ac2-4659-8cb9-9939ec42b8ea", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:38.472 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-796dbc2b-1a96-434c-84af-ef55e5153dfd', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 00:46:38.538 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c4d1624b-5ac2-4659-8cb9-9939ec42b8ea object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c4d1624b-5ac2-4659-8cb9-9939ec42b8ea", "ref-type": "overlay-role", "ref-uuid": "25900aa8-37cf-4f71-94cc-fa821f26527b", "ref-fq-name": ["default-global-system-config", "crb-mcast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:38.552 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a92c8b77-6a7b-4bf6-834f-3a32e3ae858d', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 00:46:38.611 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c4d1624b-5ac2-4659-8cb9-9939ec42b8ea object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c4d1624b-5ac2-4659-8cb9-9939ec42b8ea", "ref-type": "physical-role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:38.625 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d92a3d1d-6f99-41e0-aa7d-794576c5ee5b', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 00:46:38.689 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f0baa455-a92a-4c48-b998-bcd427343e6f object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "f0baa455-a92a-4c48-b998-bcd427343e6f", "ref-type": "feature", "ref-uuid": "420834eb-f3b0-440d-bc7a-9e97ce8b4758", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:38.703 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-2f419639-994e-4328-9d99-1e3f94928cd6', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 00:46:38.751 7fabc213b240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:38.752 7fabc213b240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:38.753 7fabc213b240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:38.753 7fabc213b240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:38.753 7fabc213b240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:38.753 7fabc213b240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:38.753 7fabc213b240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:38.753 7fabc213b240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:38.753 7fabc213b240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:38.753 7fabc213b240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:38.753 7fabc213b240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:38.754 7fabc213b240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:38.754 7fabc213b240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:46:38.754 7fabc213b240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:38.765 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f0baa455-a92a-4c48-b998-bcd427343e6f object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "f0baa455-a92a-4c48-b998-bcd427343e6f", "ref-type": "feature", "ref-uuid": "f1377070-38f1-44f6-ae3e-c48ddac79ba2", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:38.779 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-2b6281f5-9667-428a-94b5-a3bf0d7b77db', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 00:46:38.843 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f0baa455-a92a-4c48-b998-bcd427343e6f object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "f0baa455-a92a-4c48-b998-bcd427343e6f", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:38.857 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-ce1694f4-6a88-47cf-a148-47f8c39124bc', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 00:46:38.922 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f0baa455-a92a-4c48-b998-bcd427343e6f object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "f0baa455-a92a-4c48-b998-bcd427343e6f", "ref-type": "feature", "ref-uuid": "7cfd1d6a-cfde-4f81-9f77-520d8227364c", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:38.936 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-85d6215c-1dbe-46ed-a18c-cd0e0bb489fc', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 00:46:39.001 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f0baa455-a92a-4c48-b998-bcd427343e6f object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "f0baa455-a92a-4c48-b998-bcd427343e6f", "ref-type": "feature", "ref-uuid": "f91bbfbc-44bf-45ee-bd07-fbef2f77f94e", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:39.016 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-207513ac-2bf0-435b-951f-f88b04fe52bc', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 00:46:39.085 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f0baa455-a92a-4c48-b998-bcd427343e6f object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "f0baa455-a92a-4c48-b998-bcd427343e6f", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:39.104 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8a0e69a5-3632-44b7-9e47-3eccc7db3ac8', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 00:46:39.176 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f0baa455-a92a-4c48-b998-bcd427343e6f object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "f0baa455-a92a-4c48-b998-bcd427343e6f", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:39.188 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-7ce30415-47bf-4e0c-b32b-8a88781dfea7', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 00:46:39.253 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f0baa455-a92a-4c48-b998-bcd427343e6f object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "f0baa455-a92a-4c48-b998-bcd427343e6f", "ref-type": "overlay-role", "ref-uuid": "e7464c4b-993e-4687-82ea-613eab5f01b4", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:39.267 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-45dd8830-94de-4ddf-9119-a4b1cbf31465', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 00:46:39.331 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f0baa455-a92a-4c48-b998-bcd427343e6f object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "f0baa455-a92a-4c48-b998-bcd427343e6f", "ref-type": "physical-role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:39.346 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-98be72a8-26b3-497e-b734-24641737ae0c', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 00:46:39.406 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c6c638e-bbb4-4c25-b33e-52e56d8d42f7 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c6c638e-bbb4-4c25-b33e-52e56d8d42f7", "ref-type": "physical-role", "ref-uuid": "9468f342-b2f0-4492-9707-6683bd68520a", "ref-fq-name": ["default-global-system-config", "superspine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:39.420 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-e5074ce3-2d5c-4d92-8f77-78fc82cb2858', 'type': 'role_definition', 'uuid': '8c6c638e-bbb4-4c25-b33e-52e56d8d42f7'} 03/20/2025 00:46:39.481 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c6c638e-bbb4-4c25-b33e-52e56d8d42f7 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c6c638e-bbb4-4c25-b33e-52e56d8d42f7", "ref-type": "overlay-role", "ref-uuid": "d98d9778-eee7-49d1-bedd-2dc0f86c4471", "ref-fq-name": ["default-global-system-config", "lean"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:39.501 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-932463c6-90d8-4f51-a3af-7ac365216525', 'type': 'role_definition', 'uuid': '8c6c638e-bbb4-4c25-b33e-52e56d8d42f7'} 03/20/2025 00:46:39.564 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c6c638e-bbb4-4c25-b33e-52e56d8d42f7 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c6c638e-bbb4-4c25-b33e-52e56d8d42f7", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:39.580 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-5599f617-cefb-4f93-86fc-8181e0ea64e1', 'type': 'role_definition', 'uuid': '8c6c638e-bbb4-4c25-b33e-52e56d8d42f7'} 03/20/2025 00:46:39.649 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c6c638e-bbb4-4c25-b33e-52e56d8d42f7 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c6c638e-bbb4-4c25-b33e-52e56d8d42f7", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:39.665 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-ea15130c-81f4-4e16-b305-35db90d57e5d', 'type': 'role_definition', 'uuid': '8c6c638e-bbb4-4c25-b33e-52e56d8d42f7'} 03/20/2025 00:46:39.726 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c6c638e-bbb4-4c25-b33e-52e56d8d42f7 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c6c638e-bbb4-4c25-b33e-52e56d8d42f7", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:39.740 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-4be3565a-c281-4b52-9d09-4cd0d69c2826', 'type': 'role_definition', 'uuid': '8c6c638e-bbb4-4c25-b33e-52e56d8d42f7'} 03/20/2025 00:46:39.806 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5599512a-2561-4b35-9fd2-a137f3470b47 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "5599512a-2561-4b35-9fd2-a137f3470b47", "ref-type": "overlay-role", "ref-uuid": "d98d9778-eee7-49d1-bedd-2dc0f86c4471", "ref-fq-name": ["default-global-system-config", "lean"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:39.820 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-c8d047c7-119a-4d3c-8f4a-e5bb4bb37f89', 'type': 'role_definition', 'uuid': '5599512a-2561-4b35-9fd2-a137f3470b47'} 03/20/2025 00:46:39.880 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5599512a-2561-4b35-9fd2-a137f3470b47 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "5599512a-2561-4b35-9fd2-a137f3470b47", "ref-type": "physical-role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:39.898 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-5202532d-281a-49ac-bd6b-52df16fbe44f', 'type': 'role_definition', 'uuid': '5599512a-2561-4b35-9fd2-a137f3470b47'} 03/20/2025 00:46:39.961 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5599512a-2561-4b35-9fd2-a137f3470b47 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "5599512a-2561-4b35-9fd2-a137f3470b47", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:39.976 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-c74c5f15-d627-453e-9e21-d744bb120a9e', 'type': 'role_definition', 'uuid': '5599512a-2561-4b35-9fd2-a137f3470b47'} 03/20/2025 00:46:40.045 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bb538855-e8a8-41c9-b00f-5a55257e7cf2 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bb538855-e8a8-41c9-b00f-5a55257e7cf2", "ref-type": "feature", "ref-uuid": "420834eb-f3b0-440d-bc7a-9e97ce8b4758", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:40.065 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-42da0c9d-56b2-453e-ab75-d47e2133a8a9', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 00:46:40.126 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bb538855-e8a8-41c9-b00f-5a55257e7cf2 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bb538855-e8a8-41c9-b00f-5a55257e7cf2", "ref-type": "feature", "ref-uuid": "f1377070-38f1-44f6-ae3e-c48ddac79ba2", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:40.177 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f0ae4c5c-bf86-4e83-a590-0c9e92666152', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 00:46:40.253 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bb538855-e8a8-41c9-b00f-5a55257e7cf2 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bb538855-e8a8-41c9-b00f-5a55257e7cf2", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:40.275 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-bfa82ffb-2136-4797-8b2e-abbe31314975', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 00:46:40.343 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bb538855-e8a8-41c9-b00f-5a55257e7cf2 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bb538855-e8a8-41c9-b00f-5a55257e7cf2", "ref-type": "feature", "ref-uuid": "7cfd1d6a-cfde-4f81-9f77-520d8227364c", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:40.360 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-68efdbc8-640a-4e9c-a6fc-cd7bbd4282ec', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 00:46:40.425 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bb538855-e8a8-41c9-b00f-5a55257e7cf2 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bb538855-e8a8-41c9-b00f-5a55257e7cf2", "ref-type": "feature", "ref-uuid": "f91bbfbc-44bf-45ee-bd07-fbef2f77f94e", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:40.443 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3b80a395-f559-40d8-a5ec-f43912d37675', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 00:46:40.520 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bb538855-e8a8-41c9-b00f-5a55257e7cf2 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bb538855-e8a8-41c9-b00f-5a55257e7cf2", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:40.553 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-61b6c0ca-d0a2-4e2c-b892-2655ffa8a26d', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 00:46:40.615 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bb538855-e8a8-41c9-b00f-5a55257e7cf2 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bb538855-e8a8-41c9-b00f-5a55257e7cf2", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:40.631 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-fc29b15f-fbb6-4982-bf3c-c146dce011f0', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 00:46:40.691 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bb538855-e8a8-41c9-b00f-5a55257e7cf2 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bb538855-e8a8-41c9-b00f-5a55257e7cf2", "ref-type": "overlay-role", "ref-uuid": "e7464c4b-993e-4687-82ea-613eab5f01b4", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:40.703 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-210e41e2-f79b-4c8e-b446-d0701b9a407a', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 00:46:40.780 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bb538855-e8a8-41c9-b00f-5a55257e7cf2 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bb538855-e8a8-41c9-b00f-5a55257e7cf2", "ref-type": "physical-role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:40.815 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-98e03db6-d631-4986-a5ad-57b0e2308b68', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 00:46:40.878 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a95670f-1da7-468c-a621-293f19ff5e2f object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "1a95670f-1da7-468c-a621-293f19ff5e2f", "ref-type": "feature", "ref-uuid": "f1377070-38f1-44f6-ae3e-c48ddac79ba2", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:40.908 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-3e69ab77-c0be-4e6f-bb9c-978850cc8b53', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 00:46:40.977 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a95670f-1da7-468c-a621-293f19ff5e2f object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "1a95670f-1da7-468c-a621-293f19ff5e2f", "ref-type": "feature", "ref-uuid": "420834eb-f3b0-440d-bc7a-9e97ce8b4758", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:40.998 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-ff177d9a-ed6e-46e5-a555-cc8253e60339', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 00:46:41.066 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a95670f-1da7-468c-a621-293f19ff5e2f object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "1a95670f-1da7-468c-a621-293f19ff5e2f", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:41.086 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e0b39b4b-ef68-4b22-84e9-8da2e42d722d', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 00:46:41.170 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a95670f-1da7-468c-a621-293f19ff5e2f object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "1a95670f-1da7-468c-a621-293f19ff5e2f", "ref-type": "feature", "ref-uuid": "7cfd1d6a-cfde-4f81-9f77-520d8227364c", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:41.200 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-261e66c7-3bec-4b23-80df-07a848394b1e', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 00:46:41.262 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a95670f-1da7-468c-a621-293f19ff5e2f object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "1a95670f-1da7-468c-a621-293f19ff5e2f", "ref-type": "feature", "ref-uuid": "f91bbfbc-44bf-45ee-bd07-fbef2f77f94e", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:41.302 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-ca1304c7-74e0-46ba-aad2-f80f2deaba29', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 00:46:41.375 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a95670f-1da7-468c-a621-293f19ff5e2f object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "1a95670f-1da7-468c-a621-293f19ff5e2f", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:41.419 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-ee48f799-31db-451b-b7f1-db6b02228abc', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 00:46:41.483 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a95670f-1da7-468c-a621-293f19ff5e2f object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "1a95670f-1da7-468c-a621-293f19ff5e2f", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:41.523 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8ca65ee9-6713-4d64-a1b0-2b8631cb8c1b', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 00:46:41.595 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a95670f-1da7-468c-a621-293f19ff5e2f object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "1a95670f-1da7-468c-a621-293f19ff5e2f", "ref-type": "overlay-role", "ref-uuid": "c5af2d40-46cd-463e-ad5b-340c8d720ce8", "ref-fq-name": ["default-global-system-config", "dci-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:41.610 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-cd55dd01-8c3d-4528-b322-d7f82f6c03e7', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 00:46:41.696 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a95670f-1da7-468c-a621-293f19ff5e2f object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "1a95670f-1da7-468c-a621-293f19ff5e2f", "ref-type": "physical-role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:41.724 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-0b48d153-fd01-42dd-ba05-ae81930ebec9', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 00:46:41.792 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = afff3d51-5def-4b18-9404-3fefb2935eb5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "afff3d51-5def-4b18-9404-3fefb2935eb5", "ref-type": "feature", "ref-uuid": "f1377070-38f1-44f6-ae3e-c48ddac79ba2", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:41.830 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5335154c-93d1-414e-99cf-6a20a6602ab8', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 00:46:41.896 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = afff3d51-5def-4b18-9404-3fefb2935eb5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "afff3d51-5def-4b18-9404-3fefb2935eb5", "ref-type": "feature", "ref-uuid": "420834eb-f3b0-440d-bc7a-9e97ce8b4758", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:41.920 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c53127be-ee0a-4281-a475-5fc9d0dae686', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 00:46:42.015 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = afff3d51-5def-4b18-9404-3fefb2935eb5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "afff3d51-5def-4b18-9404-3fefb2935eb5", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:42.060 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-878f977a-79ff-4e0e-beee-80bf4e4243f9', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 00:46:42.086 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = afff3d51-5def-4b18-9404-3fefb2935eb5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "afff3d51-5def-4b18-9404-3fefb2935eb5", "ref-type": "feature", "ref-uuid": "7cfd1d6a-cfde-4f81-9f77-520d8227364c", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:42.117 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-14b72a12-324e-402d-940f-c84aa4f572a9', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 00:46:42.177 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = afff3d51-5def-4b18-9404-3fefb2935eb5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "afff3d51-5def-4b18-9404-3fefb2935eb5", "ref-type": "feature", "ref-uuid": "f91bbfbc-44bf-45ee-bd07-fbef2f77f94e", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:42.191 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-52e53012-733e-4e91-848e-d38454d02c23', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 00:46:42.273 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = afff3d51-5def-4b18-9404-3fefb2935eb5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "afff3d51-5def-4b18-9404-3fefb2935eb5", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:42.294 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c683e86f-7661-47c1-ae8f-ee71029c7f3b', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 00:46:42.355 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = afff3d51-5def-4b18-9404-3fefb2935eb5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "afff3d51-5def-4b18-9404-3fefb2935eb5", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:42.377 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d9bcc25a-883e-4517-b68e-1fda8f1b022a', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 00:46:42.445 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = afff3d51-5def-4b18-9404-3fefb2935eb5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "afff3d51-5def-4b18-9404-3fefb2935eb5", "ref-type": "overlay-role", "ref-uuid": "c5af2d40-46cd-463e-ad5b-340c8d720ce8", "ref-fq-name": ["default-global-system-config", "dci-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:42.458 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0c2e90bc-4e33-455a-8131-3a0392924dd0', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 00:46:42.542 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = afff3d51-5def-4b18-9404-3fefb2935eb5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "afff3d51-5def-4b18-9404-3fefb2935eb5", "ref-type": "physical-role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:42.567 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2daa3819-e399-47a5-8c3f-456333074c21', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 00:46:42.646 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c566ae8-75e7-4e69-81a7-d2c2c52fd0be object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c566ae8-75e7-4e69-81a7-d2c2c52fd0be", "ref-type": "overlay-role", "ref-uuid": "c22d4b0f-be2c-48cd-aac0-249437277343", "ref-fq-name": ["default-global-system-config", "crb-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:42.671 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-0b295f07-ba3d-4dff-842b-f9ff03d34a2e', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 00:46:42.738 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9c798d45-0b2c-4ca9-91db-6944cdbcdb41 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "9c798d45-0b2c-4ca9-91db-6944cdbcdb41", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:42.753 7fabc224c630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:42.754 7fabc224c630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:42.754 7fabc224c630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:42.754 7fabc224c630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:42.754 7fabc224c630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:42.754 7fabc224c630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:42.754 7fabc224c630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:42.755 7fabc224c630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:42.755 7fabc224c630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:42.755 7fabc224c630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:42.755 7fabc224c630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:42.755 7fabc224c630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:42.755 7fabc224c630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:46:42.755 7fabc224c630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:42.756 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0e035d98-6dae-42c7-a3fa-2b5b91bc6fe2', 'type': 'role_definition', 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'} 03/20/2025 00:46:42.839 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9c798d45-0b2c-4ca9-91db-6944cdbcdb41 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "9c798d45-0b2c-4ca9-91db-6944cdbcdb41", "ref-type": "feature", "ref-uuid": "bcd62736-bbb2-4268-a804-24fa08067c08", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:42.851 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e9da6107-c08d-4993-94b3-a94189839b69', 'type': 'role_definition', 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'} 03/20/2025 00:46:42.914 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9c798d45-0b2c-4ca9-91db-6944cdbcdb41 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "9c798d45-0b2c-4ca9-91db-6944cdbcdb41", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:42.935 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ed985e1d-7618-4791-a298-38cad52d64b0', 'type': 'role_definition', 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'} 03/20/2025 00:46:42.997 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbd1270c-2297-4d0a-bc4e-c5aa5a923e10 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbd1270c-2297-4d0a-bc4e-c5aa5a923e10", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:43.013 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-4b508651-c432-43f5-9f40-2db57bdbc3e3', 'type': 'role_definition', 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'} 03/20/2025 00:46:43.083 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbd1270c-2297-4d0a-bc4e-c5aa5a923e10 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbd1270c-2297-4d0a-bc4e-c5aa5a923e10", "ref-type": "feature", "ref-uuid": "bcd62736-bbb2-4268-a804-24fa08067c08", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:43.096 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-e2ab3cab-11a4-4e52-9d5e-5ddb3d424fa0', 'type': 'role_definition', 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'} 03/20/2025 00:46:43.165 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbd1270c-2297-4d0a-bc4e-c5aa5a923e10 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbd1270c-2297-4d0a-bc4e-c5aa5a923e10", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:43.186 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-ab2fa776-91a9-4828-a90d-56e899b77d02', 'type': 'role_definition', 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'} 03/20/2025 00:46:43.259 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4441e96d-2282-4154-a145-b28430c80f2c object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "4441e96d-2282-4154-a145-b28430c80f2c", "ref-type": "feature", "ref-uuid": "bcd62736-bbb2-4268-a804-24fa08067c08", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:43.292 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-83977576-437d-4725-93fd-4aa8a878ad85', 'type': 'role_definition', 'uuid': '4441e96d-2282-4154-a145-b28430c80f2c'} 03/20/2025 00:46:43.398 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4441e96d-2282-4154-a145-b28430c80f2c object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "4441e96d-2282-4154-a145-b28430c80f2c", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:43.436 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6ca10acc-c542-4538-9ce8-8243a2649dd5', 'type': 'role_definition', 'uuid': '4441e96d-2282-4154-a145-b28430c80f2c'} 03/20/2025 00:46:43.453 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c9fce0d0-672c-43f8-a28b-6d126af91fcb object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c9fce0d0-672c-43f8-a28b-6d126af91fcb", "ref-type": "feature", "ref-uuid": "bcd62736-bbb2-4268-a804-24fa08067c08", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:43.486 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-1c146109-3d20-418d-a0c7-9b610e0c48c8', 'type': 'role_definition', 'uuid': 'c9fce0d0-672c-43f8-a28b-6d126af91fcb'} 03/20/2025 00:46:43.554 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c9fce0d0-672c-43f8-a28b-6d126af91fcb object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c9fce0d0-672c-43f8-a28b-6d126af91fcb", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:43.578 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-2e0ee099-38ac-45b0-9a1e-bbb8796cd528', 'type': 'role_definition', 'uuid': 'c9fce0d0-672c-43f8-a28b-6d126af91fcb'} 03/20/2025 00:46:43.655 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9c798d45-0b2c-4ca9-91db-6944cdbcdb41 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "9c798d45-0b2c-4ca9-91db-6944cdbcdb41", "ref-type": "physical-role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:43.682 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-89abb82d-ef57-4496-8d56-61c208b26e60', 'type': 'role_definition', 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'} 03/20/2025 00:46:43.747 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9c798d45-0b2c-4ca9-91db-6944cdbcdb41 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "9c798d45-0b2c-4ca9-91db-6944cdbcdb41", "ref-type": "overlay-role", "ref-uuid": "2af03efa-2b74-49eb-8fac-b8edafd82bfa", "ref-fq-name": ["default-global-system-config", "ar-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:43.781 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-43140398-bbe9-4396-8063-48f9aa2c4dd4', 'type': 'role_definition', 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'} 03/20/2025 00:46:43.859 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbd1270c-2297-4d0a-bc4e-c5aa5a923e10 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbd1270c-2297-4d0a-bc4e-c5aa5a923e10", "ref-type": "physical-role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:43.875 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-9f297ca6-477c-498b-9ddc-16fc9d007b75', 'type': 'role_definition', 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'} 03/20/2025 00:46:43.948 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbd1270c-2297-4d0a-bc4e-c5aa5a923e10 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbd1270c-2297-4d0a-bc4e-c5aa5a923e10", "ref-type": "overlay-role", "ref-uuid": "2af03efa-2b74-49eb-8fac-b8edafd82bfa", "ref-fq-name": ["default-global-system-config", "ar-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:43.964 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-f3a9e104-e401-4a08-9f3d-e868039c0dac', 'type': 'role_definition', 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'} 03/20/2025 00:46:44.034 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4441e96d-2282-4154-a145-b28430c80f2c object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "4441e96d-2282-4154-a145-b28430c80f2c", "ref-type": "physical-role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:44.048 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f21397dd-0153-4fcb-a33d-decf0ba58de1', 'type': 'role_definition', 'uuid': '4441e96d-2282-4154-a145-b28430c80f2c'} 03/20/2025 00:46:44.121 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4441e96d-2282-4154-a145-b28430c80f2c object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "4441e96d-2282-4154-a145-b28430c80f2c", "ref-type": "overlay-role", "ref-uuid": "39d1feb4-f71b-4f2a-ae7b-93b1dc707367", "ref-fq-name": ["default-global-system-config", "ar-client"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:44.137 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5b0317a4-3281-4542-b3cf-146f456f8e9e', 'type': 'role_definition', 'uuid': '4441e96d-2282-4154-a145-b28430c80f2c'} 03/20/2025 00:46:44.207 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c9fce0d0-672c-43f8-a28b-6d126af91fcb object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c9fce0d0-672c-43f8-a28b-6d126af91fcb", "ref-type": "physical-role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:44.226 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-063a1c69-3d8c-4767-a01e-df92aac19b8d', 'type': 'role_definition', 'uuid': 'c9fce0d0-672c-43f8-a28b-6d126af91fcb'} 03/20/2025 00:46:44.288 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 728e4e7e-bf64-4d72-bb64-c75977af55b6 object_type = role_definition identifier_name = default-global-system-config:rr-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "728e4e7e-bf64-4d72-bb64-c75977af55b6", "ref-type": "physical-role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:44.302 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-1b623c69-fa85-4265-8c54-9476a0742def', 'type': 'role_definition', 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'} 03/20/2025 00:46:44.369 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 35e70721-3adc-4580-ae4a-904e96a85476 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "35e70721-3adc-4580-ae4a-904e96a85476", "ref-type": "physical-role", "ref-uuid": "9468f342-b2f0-4492-9707-6683bd68520a", "ref-fq-name": ["default-global-system-config", "superspine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:44.396 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-c1e2eafa-80e8-4ded-98ea-06311af4abe2', 'type': 'role_definition', 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'} 03/20/2025 00:46:44.466 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = edf8da1e-1590-48a9-8480-66bcae438a53 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "edf8da1e-1590-48a9-8480-66bcae438a53", "ref-type": "physical-role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:44.488 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c5ef9aef-761f-46a5-ac0b-d3069859b4e5', 'type': 'role_definition', 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'} 03/20/2025 00:46:44.559 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c9fce0d0-672c-43f8-a28b-6d126af91fcb object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c9fce0d0-672c-43f8-a28b-6d126af91fcb", "ref-type": "overlay-role", "ref-uuid": "39d1feb4-f71b-4f2a-ae7b-93b1dc707367", "ref-fq-name": ["default-global-system-config", "ar-client"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:44.577 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-66f78cd4-489e-46d7-bd94-73bef6a0b15f', 'type': 'role_definition', 'uuid': 'c9fce0d0-672c-43f8-a28b-6d126af91fcb'} 03/20/2025 00:46:44.643 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 35e70721-3adc-4580-ae4a-904e96a85476 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "35e70721-3adc-4580-ae4a-904e96a85476", "ref-type": "overlay-role", "ref-uuid": "3de07b17-fb11-4d37-aba5-a1243fbb9114", "ref-fq-name": ["default-global-system-config", "route-reflector"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:44.655 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-7f6c52ec-eb44-4bc3-9f96-f2a64575b1f0', 'type': 'role_definition', 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'} 03/20/2025 00:46:44.718 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 35e70721-3adc-4580-ae4a-904e96a85476 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "35e70721-3adc-4580-ae4a-904e96a85476", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:44.730 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-49267732-5b13-45a4-a558-5bb70af262e8', 'type': 'role_definition', 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'} 03/20/2025 00:46:44.795 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 35e70721-3adc-4580-ae4a-904e96a85476 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "35e70721-3adc-4580-ae4a-904e96a85476", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:44.810 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-ef706d29-2f37-429a-8493-01f130a197e8', 'type': 'role_definition', 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'} 03/20/2025 00:46:44.875 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 35e70721-3adc-4580-ae4a-904e96a85476 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "35e70721-3adc-4580-ae4a-904e96a85476", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:44.896 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-41b757a8-e67d-4d38-bd07-1546025d270f', 'type': 'role_definition', 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'} 03/20/2025 00:46:44.964 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 35e70721-3adc-4580-ae4a-904e96a85476 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "35e70721-3adc-4580-ae4a-904e96a85476", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:44.990 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-af32a29b-07f4-4283-99e6-e334708dde3a', 'type': 'role_definition', 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'} 03/20/2025 00:46:45.053 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 728e4e7e-bf64-4d72-bb64-c75977af55b6 object_type = role_definition identifier_name = default-global-system-config:rr-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "728e4e7e-bf64-4d72-bb64-c75977af55b6", "ref-type": "overlay-role", "ref-uuid": "3de07b17-fb11-4d37-aba5-a1243fbb9114", "ref-fq-name": ["default-global-system-config", "route-reflector"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:45.073 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-05f752ab-0727-45e3-8e29-7be0e8a0340e', 'type': 'role_definition', 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'} 03/20/2025 00:46:45.141 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 728e4e7e-bf64-4d72-bb64-c75977af55b6 object_type = role_definition identifier_name = default-global-system-config:rr-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "728e4e7e-bf64-4d72-bb64-c75977af55b6", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:45.154 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-8b5d5e42-6f66-4e14-8a6e-201358072ccb', 'type': 'role_definition', 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'} 03/20/2025 00:46:45.221 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 728e4e7e-bf64-4d72-bb64-c75977af55b6 object_type = role_definition identifier_name = default-global-system-config:rr-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "728e4e7e-bf64-4d72-bb64-c75977af55b6", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:45.234 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-e44aac5d-b9e2-4c91-bea0-1e086eda86ea', 'type': 'role_definition', 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'} 03/20/2025 00:46:45.301 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 728e4e7e-bf64-4d72-bb64-c75977af55b6 object_type = role_definition identifier_name = default-global-system-config:rr-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "728e4e7e-bf64-4d72-bb64-c75977af55b6", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:45.315 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-9f3677c9-7cd9-4dfc-a276-f23f278516c9', 'type': 'role_definition', 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'} 03/20/2025 00:46:45.375 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = edf8da1e-1590-48a9-8480-66bcae438a53 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "edf8da1e-1590-48a9-8480-66bcae438a53", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:45.387 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c5292ff1-8aae-46e3-8e9c-d5e80b0463c1', 'type': 'role_definition', 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'} 03/20/2025 00:46:45.461 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = edf8da1e-1590-48a9-8480-66bcae438a53 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "edf8da1e-1590-48a9-8480-66bcae438a53", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:45.476 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c09942c0-a618-483b-977c-67db31c1adfe', 'type': 'role_definition', 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'} 03/20/2025 00:46:45.542 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = edf8da1e-1590-48a9-8480-66bcae438a53 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "edf8da1e-1590-48a9-8480-66bcae438a53", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:45.554 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a5457aad-1c73-48ea-a3d9-34e22cc6ed26', 'type': 'role_definition', 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'} 03/20/2025 00:46:45.617 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = edf8da1e-1590-48a9-8480-66bcae438a53 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "edf8da1e-1590-48a9-8480-66bcae438a53", "ref-type": "overlay-role", "ref-uuid": "3de07b17-fb11-4d37-aba5-a1243fbb9114", "ref-fq-name": ["default-global-system-config", "route-reflector"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:45.631 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c33338a1-8ca6-477c-9cf2-fe302be6dbc0', 'type': 'role_definition', 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'} 03/20/2025 00:46:45.694 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fad1e96f-8862-4fab-bb10-aa63d51ee561 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "fad1e96f-8862-4fab-bb10-aa63d51ee561", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:45.710 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ab9b8263-6f24-4247-b790-d7a81d0ebe3b', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 00:46:45.775 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29c66905-1418-4dd7-8013-34e78036e6ce object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29c66905-1418-4dd7-8013-34e78036e6ce", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:45.792 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a7342564-8776-4565-b629-f690b8b8e1e4', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 00:46:45.856 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c566ae8-75e7-4e69-81a7-d2c2c52fd0be object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "8c566ae8-75e7-4e69-81a7-d2c2c52fd0be", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:45.869 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-f0956651-904c-47db-836b-1b025f35d3df', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 00:46:45.932 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbdee73d-ee96-4741-80b8-6787a2819670 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbdee73d-ee96-4741-80b8-6787a2819670", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:45.945 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-237a2065-435a-4ab0-b051-ca452f8af731', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 00:46:46.010 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29269d01-b04e-44db-9eee-019d549f7157 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29269d01-b04e-44db-9eee-019d549f7157", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:46.023 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-0dfc9949-c99d-4239-91b1-8f46167c0b37', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 00:46:46.086 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f0baa455-a92a-4c48-b998-bcd427343e6f object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "f0baa455-a92a-4c48-b998-bcd427343e6f", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:46.100 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-44377b21-461c-481e-b42f-11f4891f4421', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 00:46:46.170 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a95670f-1da7-468c-a621-293f19ff5e2f object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "1a95670f-1da7-468c-a621-293f19ff5e2f", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:46.183 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-62b73533-6b61-4677-b663-ebfc99c766be', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 00:46:46.244 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e21727ee-f7c6-47ab-b972-cc324d2970e4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "e21727ee-f7c6-47ab-b972-cc324d2970e4", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:46.259 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c344fbed-4cbd-4942-9ca6-b7c33a3ee2d0', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 00:46:46.319 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c4d1624b-5ac2-4659-8cb9-9939ec42b8ea object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c4d1624b-5ac2-4659-8cb9-9939ec42b8ea", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:46.338 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7c3e7b9e-fe5f-4976-8879-b4d6642f0506', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 00:46:46.403 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bb538855-e8a8-41c9-b00f-5a55257e7cf2 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bb538855-e8a8-41c9-b00f-5a55257e7cf2", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:46.416 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-55a9f097-86a9-4fa0-9a79-7563e071ccbc', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 00:46:46.476 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = afff3d51-5def-4b18-9404-3fefb2935eb5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "afff3d51-5def-4b18-9404-3fefb2935eb5", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:46.489 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4f9cf6d1-c2cf-4b41-a578-10d6073090a9', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 00:46:46.552 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4441e96d-2282-4154-a145-b28430c80f2c object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "4441e96d-2282-4154-a145-b28430c80f2c", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:46.563 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-13cbfea5-55c2-49f2-a715-92e1cf65d88e', 'type': 'role_definition', 'uuid': '4441e96d-2282-4154-a145-b28430c80f2c'} 03/20/2025 00:46:46.623 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c9fce0d0-672c-43f8-a28b-6d126af91fcb object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c9fce0d0-672c-43f8-a28b-6d126af91fcb", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:46.634 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-70cc3508-0f97-44c5-b51f-fd520f4591e6', 'type': 'role_definition', 'uuid': 'c9fce0d0-672c-43f8-a28b-6d126af91fcb'} 03/20/2025 00:46:46.695 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9c798d45-0b2c-4ca9-91db-6944cdbcdb41 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "9c798d45-0b2c-4ca9-91db-6944cdbcdb41", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:46.707 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-493af711-e4fd-4cb0-82ae-2f2a3181bf29', 'type': 'role_definition', 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'} 03/20/2025 00:46:46.755 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:46.756 7fabc20746d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:46.756 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:46.756 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:46.756 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:46.756 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:46.756 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:46.757 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:46.757 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:46.757 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:46.757 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:46.757 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:46.757 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:46:46.757 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:46.771 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbd1270c-2297-4d0a-bc4e-c5aa5a923e10 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbd1270c-2297-4d0a-bc4e-c5aa5a923e10", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:46.805 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-c101bd9c-b133-4b94-a403-e47c83606096', 'type': 'role_definition', 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'} 03/20/2025 00:46:46.857 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 728e4e7e-bf64-4d72-bb64-c75977af55b6 object_type = role_definition identifier_name = default-global-system-config:rr-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "728e4e7e-bf64-4d72-bb64-c75977af55b6", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:46.877 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-b76ee861-d914-4922-b062-e5de578261ea', 'type': 'role_definition', 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'} 03/20/2025 00:46:46.932 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = edf8da1e-1590-48a9-8480-66bcae438a53 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "edf8da1e-1590-48a9-8480-66bcae438a53", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:46.947 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-80a992bd-1a79-4518-82b3-5b21f5803783', 'type': 'role_definition', 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'} 03/20/2025 00:46:47.007 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5599512a-2561-4b35-9fd2-a137f3470b47 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "5599512a-2561-4b35-9fd2-a137f3470b47", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:47.019 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-517f7e39-a975-4fac-9526-337bccc295b4', 'type': 'role_definition', 'uuid': '5599512a-2561-4b35-9fd2-a137f3470b47'} 03/20/2025 00:46:47.086 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbdee73d-ee96-4741-80b8-6787a2819670 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbdee73d-ee96-4741-80b8-6787a2819670", "ref-type": "feature", "ref-uuid": "420834eb-f3b0-440d-bc7a-9e97ce8b4758", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:47.100 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-70839503-de04-4306-b17c-c911c3a839fe', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 00:46:47.167 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbdee73d-ee96-4741-80b8-6787a2819670 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "bbdee73d-ee96-4741-80b8-6787a2819670", "ref-type": "feature", "ref-uuid": "112418ab-2ad1-4403-92b9-7f47c3c0e4ea", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:47.184 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-813c10cf-12fd-404f-bdd2-b4bf5d51a98e', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 00:46:47.254 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e21727ee-f7c6-47ab-b972-cc324d2970e4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "e21727ee-f7c6-47ab-b972-cc324d2970e4", "ref-type": "feature", "ref-uuid": "420834eb-f3b0-440d-bc7a-9e97ce8b4758", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:47.277 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-23c806e3-184c-424f-9670-54062530a30f', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 00:46:47.338 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e21727ee-f7c6-47ab-b972-cc324d2970e4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "e21727ee-f7c6-47ab-b972-cc324d2970e4", "ref-type": "feature", "ref-uuid": "112418ab-2ad1-4403-92b9-7f47c3c0e4ea", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:47.355 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8250bc75-1a54-406a-82d9-9d4db95b4e1b', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 00:46:47.420 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29269d01-b04e-44db-9eee-019d549f7157 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29269d01-b04e-44db-9eee-019d549f7157", "ref-type": "feature", "ref-uuid": "420834eb-f3b0-440d-bc7a-9e97ce8b4758", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:47.434 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-78dbf261-259c-4f75-a4b8-d4dadd00a279', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 00:46:47.525 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29269d01-b04e-44db-9eee-019d549f7157 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "29269d01-b04e-44db-9eee-019d549f7157", "ref-type": "feature", "ref-uuid": "112418ab-2ad1-4403-92b9-7f47c3c0e4ea", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:47.538 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-86954bca-9842-4230-a9af-8503cfd793e1', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 00:46:47.617 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c4d1624b-5ac2-4659-8cb9-9939ec42b8ea object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c4d1624b-5ac2-4659-8cb9-9939ec42b8ea", "ref-type": "feature", "ref-uuid": "420834eb-f3b0-440d-bc7a-9e97ce8b4758", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:47.636 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-35e5b7bd-0059-4dff-92e5-ae6db4429b4e', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 00:46:47.664 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c4d1624b-5ac2-4659-8cb9-9939ec42b8ea object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "c4d1624b-5ac2-4659-8cb9-9939ec42b8ea", "ref-type": "feature", "ref-uuid": "112418ab-2ad1-4403-92b9-7f47c3c0e4ea", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:47.689 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-088bfad7-d118-4b61-8a0e-1034d3761998', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 00:46:47.754 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5599512a-2561-4b35-9fd2-a137f3470b47 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "5599512a-2561-4b35-9fd2-a137f3470b47", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:47.775 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-7e334fdf-0208-4afd-bf3f-23da82c74f3c', 'type': 'role_definition', 'uuid': '5599512a-2561-4b35-9fd2-a137f3470b47'} 03/20/2025 00:46:47.846 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed79f827-69d7-4efe-8849-b59ed841e4e5 object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "ed79f827-69d7-4efe-8849-b59ed841e4e5", "ref-type": "feature", "ref-uuid": "f1377070-38f1-44f6-ae3e-c48ddac79ba2", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:47.860 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-dea14fcc-cbaa-4975-a316-cfc3fec997b2', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 00:46:47.929 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed79f827-69d7-4efe-8849-b59ed841e4e5 object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "ed79f827-69d7-4efe-8849-b59ed841e4e5", "ref-type": "feature", "ref-uuid": "40fed233-7ed4-423d-957b-e65ddf97b206", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:47.949 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-aaaf6047-8eea-499f-8536-e38d61723040', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 00:46:48.044 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed79f827-69d7-4efe-8849-b59ed841e4e5 object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "ed79f827-69d7-4efe-8849-b59ed841e4e5", "ref-type": "feature", "ref-uuid": "7cfd1d6a-cfde-4f81-9f77-520d8227364c", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:48.074 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-92a10649-ded9-4a49-acf4-4ac9623e1ee2', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 00:46:48.152 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed79f827-69d7-4efe-8849-b59ed841e4e5 object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "ed79f827-69d7-4efe-8849-b59ed841e4e5", "ref-type": "feature", "ref-uuid": "b9253aaa-a083-4273-b203-5e6c2c1ac1f6", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:48.169 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-f772b022-3649-4973-b513-287769ad22bb', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 00:46:48.238 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed79f827-69d7-4efe-8849-b59ed841e4e5 object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "ed79f827-69d7-4efe-8849-b59ed841e4e5", "ref-type": "feature", "ref-uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:48.253 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-c5206b6c-86b5-4436-9bf8-aea7f7e88094', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 00:46:48.312 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed79f827-69d7-4efe-8849-b59ed841e4e5 object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "ed79f827-69d7-4efe-8849-b59ed841e4e5", "ref-type": "feature", "ref-uuid": "420834eb-f3b0-440d-bc7a-9e97ce8b4758", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:48.333 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-bd198e66-296e-4f95-ad83-a9a5d5a76c3e', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 00:46:48.399 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed79f827-69d7-4efe-8849-b59ed841e4e5 object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "ed79f827-69d7-4efe-8849-b59ed841e4e5", "ref-type": "feature", "ref-uuid": "112418ab-2ad1-4403-92b9-7f47c3c0e4ea", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:48.416 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-abe62fe0-86d2-4c00-b194-b4aaf67ce74b', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 00:46:48.486 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed79f827-69d7-4efe-8849-b59ed841e4e5 object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "ed79f827-69d7-4efe-8849-b59ed841e4e5", "ref-type": "feature", "ref-uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:48.503 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-7566c03e-7ba2-4a4d-a584-68b0e5390be4', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 00:46:48.564 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed79f827-69d7-4efe-8849-b59ed841e4e5 object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "ed79f827-69d7-4efe-8849-b59ed841e4e5", "ref-type": "feature", "ref-uuid": "4c647a97-0e6e-41fb-9220-b4fa5b91a202", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:48.582 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-0d2b6880-fd29-4914-9b4a-00dbd47fd674', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 00:46:48.656 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed79f827-69d7-4efe-8849-b59ed841e4e5 object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "ed79f827-69d7-4efe-8849-b59ed841e4e5", "ref-type": "overlay-role", "ref-uuid": "bfdb2e08-75d8-4995-97a1-f29320f374a1", "ref-fq-name": ["default-global-system-config", "collapsed-spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:48.682 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-0b0506bc-8c50-4e73-a57e-cd050f8f6657', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 00:46:48.745 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed79f827-69d7-4efe-8849-b59ed841e4e5 object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "ed79f827-69d7-4efe-8849-b59ed841e4e5", "ref-type": "physical-role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:48.766 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-780fc6ea-a4f1-452f-8cf6-bbbce5fff00a', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 00:46:48.830 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 497e1087-553f-474a-a3e1-980bcbab6811 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "497e1087-553f-474a-a3e1-980bcbab6811", "ref-type": "feature", "ref-uuid": "98ebec57-59ce-4727-b2ff-f42d908b981f", "ref-fq-name": ["default-global-system-config", "pnf-service-chaining"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:48.850 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-27753d41-17dd-4171-919a-822e7574acff', 'type': 'role_definition', 'uuid': '497e1087-553f-474a-a3e1-980bcbab6811'} 03/20/2025 00:46:48.924 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9dd9ebf4-7da7-464c-82d2-83006561567f object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "9dd9ebf4-7da7-464c-82d2-83006561567f", "ref-type": "feature", "ref-uuid": "98ebec57-59ce-4727-b2ff-f42d908b981f", "ref-fq-name": ["default-global-system-config", "pnf-service-chaining"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:48.944 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-cbd751c8-db6c-4e9c-a810-148b14e6e696', 'type': 'role_definition', 'uuid': '9dd9ebf4-7da7-464c-82d2-83006561567f'} 03/20/2025 00:46:49.007 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d18b1b93-9d78-4930-827f-c4c6e3b9d639 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "d18b1b93-9d78-4930-827f-c4c6e3b9d639", "ref-type": "feature", "ref-uuid": "98ebec57-59ce-4727-b2ff-f42d908b981f", "ref-fq-name": ["default-global-system-config", "pnf-service-chaining"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:49.030 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0fef0c62-59dc-4918-b754-d919ad9e51d7', 'type': 'role_definition', 'uuid': 'd18b1b93-9d78-4930-827f-c4c6e3b9d639'} 03/20/2025 00:46:49.096 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 497e1087-553f-474a-a3e1-980bcbab6811 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "497e1087-553f-474a-a3e1-980bcbab6811", "ref-type": "physical-role", "ref-uuid": "761deadb-c5f9-4384-8e5f-30aab996f17f", "ref-fq-name": ["default-global-system-config", "pnf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:49.108 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-1740d1ab-ed7e-406e-a2c3-440647b5e796', 'type': 'role_definition', 'uuid': '497e1087-553f-474a-a3e1-980bcbab6811'} 03/20/2025 00:46:49.175 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9dd9ebf4-7da7-464c-82d2-83006561567f object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "9dd9ebf4-7da7-464c-82d2-83006561567f", "ref-type": "physical-role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:49.190 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-bc0db02b-e838-4f4e-815a-6c380b327f1a', 'type': 'role_definition', 'uuid': '9dd9ebf4-7da7-464c-82d2-83006561567f'} 03/20/2025 00:46:49.253 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d18b1b93-9d78-4930-827f-c4c6e3b9d639 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "d18b1b93-9d78-4930-827f-c4c6e3b9d639", "ref-type": "physical-role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:49.267 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a98df565-df19-4c90-b2a0-3d38507f5381', 'type': 'role_definition', 'uuid': 'd18b1b93-9d78-4930-827f-c4c6e3b9d639'} 03/20/2025 00:46:49.336 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 497e1087-553f-474a-a3e1-980bcbab6811 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "497e1087-553f-474a-a3e1-980bcbab6811", "ref-type": "overlay-role", "ref-uuid": "8e4d7c54-fa65-476a-a2bd-6fcfcd955dac", "ref-fq-name": ["default-global-system-config", "pnf-servicechain"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:49.353 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-4c1a5b30-f01a-449d-8dac-85efb27ad48e', 'type': 'role_definition', 'uuid': '497e1087-553f-474a-a3e1-980bcbab6811'} 03/20/2025 00:46:49.419 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9dd9ebf4-7da7-464c-82d2-83006561567f object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "9dd9ebf4-7da7-464c-82d2-83006561567f", "ref-type": "overlay-role", "ref-uuid": "8e4d7c54-fa65-476a-a2bd-6fcfcd955dac", "ref-fq-name": ["default-global-system-config", "pnf-servicechain"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:49.432 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-a3579db9-847d-4548-8f73-fae6d583a377', 'type': 'role_definition', 'uuid': '9dd9ebf4-7da7-464c-82d2-83006561567f'} 03/20/2025 00:46:49.502 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d18b1b93-9d78-4930-827f-c4c6e3b9d639 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "role-definition", "uuid": "d18b1b93-9d78-4930-827f-c4c6e3b9d639", "ref-type": "overlay-role", "ref-uuid": "8e4d7c54-fa65-476a-a2bd-6fcfcd955dac", "ref-fq-name": ["default-global-system-config", "pnf-servicechain"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:49.517 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a5c50afa-235f-4704-bdc8-0dd1bec84bc7', 'type': 'role_definition', 'uuid': 'd18b1b93-9d78-4930-827f-c4c6e3b9d639'} 03/20/2025 00:46:49.581 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "af195950-079e-4902-98e2-6527fc862d94", "ref-fq-name": ["juniper-qfx5100-48sh-afi"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:49.608 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-8e7bc0ae-dd00-47d5-89d5-1bb3f421d2d8', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:49.674 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "a9df6e2f-ec33-44b4-9820-cae2d48330d0", "ref-fq-name": ["juniper-qfx5100-48sh-afo"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:49.695 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-517f5451-92a9-4ff7-8338-e1d69d777d0e', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:49.766 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "8728829f-2197-4a71-af55-daa7e12b1ed0", "ref-fq-name": ["juniper-qfx5100-48th-afi"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:49.809 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-36e6fb6e-5e7a-4fc9-a2e5-c5ce6dd7404b', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:49.878 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "64ee2add-3c72-41cb-9629-07740b1e4fbf", "ref-fq-name": ["juniper-qfx5100-48th-afo"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:49.895 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-8ac1cf2c-5b5f-4423-a2d4-98fc2ee93021', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:49.964 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "fcb12878-be75-4af6-b628-658a82be2c05", "ref-fq-name": ["juniper-qfx5100-48s-6q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:49.980 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-3866966f-93c4-4329-aa55-a42347db23e8', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:50.047 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "b5fda0b8-96b6-47a2-be59-c923311f6222", "ref-fq-name": ["juniper-qfx5100-96s-8q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:50.059 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-56f97b39-6324-49b6-8a38-83b2499f49a9', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:50.141 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "aa6f29a0-5722-40d5-973e-bbb5cd4e89d8", "ref-fq-name": ["juniper-qfx5100-48t"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:50.171 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-c5189f64-bac9-44bd-9223-54fb033c7b09', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:50.253 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "1d2d462d-0fb2-4789-ad74-a17b69549fbe", "ref-fq-name": ["juniper-qfx5100-48t-6q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:50.309 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-414b8b0d-ce3b-4552-99df-b6446f9b633b', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:50.389 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "e37b1144-2678-44f5-ac06-565c85dba363", "ref-fq-name": ["juniper-qfx5100-24q-2p"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:50.407 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-0b89ab45-e845-4494-9386-a88db4205211', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:50.468 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "b8e9304b-5ff1-49fa-a46e-5e4eec0575d7", "ref-fq-name": ["juniper-qfx5100-24q-aa"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:50.490 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-e5b8b004-3a13-486d-ad35-d351cf3a4da5', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:50.554 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "3192d0f9-2cf6-4140-81bb-bffe860ed3a7", "ref-fq-name": ["juniper-qfx5100e-48s-6q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:50.570 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-762c2d83-205e-4d27-b222-b9bece57b735', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:50.634 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "fbca2bde-1157-4c32-8d85-94628655a50d", "ref-fq-name": ["juniper-qfx5100e-96s-8q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:50.650 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-0806576f-71df-4727-8978-50e78ec4fca9', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:50.731 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "66d4fb5c-8901-49cd-8d5f-33d2f144be7a", "ref-fq-name": ["juniper-qfx5100e-48t-6q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:50.762 7fabc209b390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:50.764 7fabc209b390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:50.765 7fabc209b390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:50.765 7fabc209b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:50.765 7fabc209b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:50.766 7fabc209b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:50.766 7fabc209b390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:50.767 7fabc209b390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:50.767 7fabc209b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:50.767 7fabc209b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:50.767 7fabc209b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:50.767 7fabc209b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:50.767 7fabc209b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:46:50.768 7fabc209b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:50.768 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-7ad8df45-fc65-4b7c-8a1a-6bf7408db82f', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:50.840 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "d764f786-f2fe-4657-bc22-7632490bffe1", "ref-fq-name": ["juniper-qfx5100e-24q-2p"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:50.856 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-f91f63f9-2051-42c8-bf2f-4d6e0b55248b', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:50.921 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4164eb8f-2292-46fc-a598-6109c75e61ee object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "4164eb8f-2292-46fc-a598-6109c75e61ee", "ref-type": "hardware", "ref-uuid": "fa1a34c7-5f27-4549-8796-aadaea4de410", "ref-fq-name": ["juniper-qfx5110-48s-4c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:50.936 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-89be99b5-3484-470e-8f53-fdc459717590', 'type': 'node_profile', 'uuid': '4164eb8f-2292-46fc-a598-6109c75e61ee'} 03/20/2025 00:46:51.004 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4164eb8f-2292-46fc-a598-6109c75e61ee object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "4164eb8f-2292-46fc-a598-6109c75e61ee", "ref-type": "hardware", "ref-uuid": "c3fec083-dd82-4083-b3f2-453812057208", "ref-fq-name": ["juniper-qfx5110-32q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:51.021 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-fc9094ab-86ca-4531-9fba-640206575d74', 'type': 'node_profile', 'uuid': '4164eb8f-2292-46fc-a598-6109c75e61ee'} 03/20/2025 00:46:51.085 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 80bfcdb7-a052-4c12-a3ac-4c07d8f464fa object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "80bfcdb7-a052-4c12-a3ac-4c07d8f464fa", "ref-type": "hardware", "ref-uuid": "27ecd611-514e-4d80-a2d4-3021696d7eb9", "ref-fq-name": ["juniper-qfx5120-48y-8c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:51.101 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-0226904b-76c2-4317-a375-b9a27c20d924', 'type': 'node_profile', 'uuid': '80bfcdb7-a052-4c12-a3ac-4c07d8f464fa'} 03/20/2025 00:46:51.166 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 80bfcdb7-a052-4c12-a3ac-4c07d8f464fa object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "80bfcdb7-a052-4c12-a3ac-4c07d8f464fa", "ref-type": "hardware", "ref-uuid": "1742fce4-8197-411d-a693-a0540bbe40ab", "ref-fq-name": ["juniper-qfx5120-32c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:51.184 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-77158d38-c982-4186-a158-d4aa47ddcadd', 'type': 'node_profile', 'uuid': '80bfcdb7-a052-4c12-a3ac-4c07d8f464fa'} 03/20/2025 00:46:51.247 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 80bfcdb7-a052-4c12-a3ac-4c07d8f464fa object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "80bfcdb7-a052-4c12-a3ac-4c07d8f464fa", "ref-type": "hardware", "ref-uuid": "d279f6fc-b9c8-4f4d-8d73-da112b1c5da1", "ref-fq-name": ["juniper-qfx5120-48t-6c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:51.261 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-dcf1f52a-e6d7-4985-bdf2-0035bb2fe915', 'type': 'node_profile', 'uuid': '80bfcdb7-a052-4c12-a3ac-4c07d8f464fa'} 03/20/2025 00:46:51.328 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "b58382bd-da81-487b-ac73-e48a93b6b9b1", "ref-fq-name": ["juniper-qfx5200-32c-32q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:51.346 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-091383a5-a88d-402b-817a-ac2b976c3760', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:51.418 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "d9afe4fa-f539-47d6-a1b7-c9f0173c023e", "ref-fq-name": ["juniper-qfx5200-48y"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:51.431 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-cc957834-25ff-44bc-974f-202b948f2799', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:51.496 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "hardware", "ref-uuid": "f84879fb-9269-4886-abeb-2c4b6fb23853", "ref-fq-name": ["juniper-qfx5210-64c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:51.509 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-a145652a-3197-4d77-b331-8c9043d6bfdc', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:51.577 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 552231da-108a-4ff3-9b6c-046ffcac8f18 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5220 url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "552231da-108a-4ff3-9b6c-046ffcac8f18", "ref-type": "hardware", "ref-uuid": "1c5db8fa-469d-4860-acb2-4ef132de2663", "ref-fq-name": ["juniper-qfx5220-32cd"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:51.592 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-460b9d68-a810-4d5c-906e-14eadd1bbcd7', 'type': 'node_profile', 'uuid': '552231da-108a-4ff3-9b6c-046ffcac8f18'} 03/20/2025 00:46:51.653 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 552231da-108a-4ff3-9b6c-046ffcac8f18 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5220 url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "552231da-108a-4ff3-9b6c-046ffcac8f18", "ref-type": "hardware", "ref-uuid": "37463e7e-9d10-4804-b22b-14d30a1efe3f", "ref-fq-name": ["juniper-qfx5220-128c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:51.682 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-5fbb520a-a4ae-4605-8d0d-6458f45b8a50', 'type': 'node_profile', 'uuid': '552231da-108a-4ff3-9b6c-046ffcac8f18'} 03/20/2025 00:46:51.758 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = abdf3f77-b2d2-4412-949f-61dd3db2e1c1 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "abdf3f77-b2d2-4412-949f-61dd3db2e1c1", "ref-type": "hardware", "ref-uuid": "72219265-ef00-41f3-aec1-7902e209cec0", "ref-fq-name": ["juniper-qfx10002-72q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:51.784 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-61bf5f32-5c63-4e28-bd10-c7d1da0773fd', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 00:46:51.868 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = abdf3f77-b2d2-4412-949f-61dd3db2e1c1 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "abdf3f77-b2d2-4412-949f-61dd3db2e1c1", "ref-type": "hardware", "ref-uuid": "7d4d0c09-3cab-4c5a-910d-513627d87940", "ref-fq-name": ["juniper-qfx10002-36q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:51.888 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-a01060f2-f098-4a6c-9aea-12d67f3a8e5d', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 00:46:51.964 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = abdf3f77-b2d2-4412-949f-61dd3db2e1c1 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "abdf3f77-b2d2-4412-949f-61dd3db2e1c1", "ref-type": "hardware", "ref-uuid": "5adb57cf-4039-453d-95b2-5bd4d082bf12", "ref-fq-name": ["juniper-qfx10002-60c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:51.979 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-7894c303-64ea-446e-b447-de7090cece87', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 00:46:52.046 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = abdf3f77-b2d2-4412-949f-61dd3db2e1c1 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "abdf3f77-b2d2-4412-949f-61dd3db2e1c1", "ref-type": "hardware", "ref-uuid": "fb7680b6-1f0f-466c-a7f3-8ad8f1e9aabc", "ref-fq-name": ["juniper-qfx10016"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:52.058 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-e93b8fab-9a87-47b3-9f93-cb3652b7af16', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 00:46:52.125 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = abdf3f77-b2d2-4412-949f-61dd3db2e1c1 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "abdf3f77-b2d2-4412-949f-61dd3db2e1c1", "ref-type": "hardware", "ref-uuid": "93247cc2-4f3a-474e-b057-eaaca5558e5b", "ref-fq-name": ["juniper-qfx10008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:52.137 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-53731693-129b-49be-a397-4fd55a15c8c2', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 00:46:52.202 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = abdf3f77-b2d2-4412-949f-61dd3db2e1c1 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "abdf3f77-b2d2-4412-949f-61dd3db2e1c1", "ref-type": "hardware", "ref-uuid": "686e7a79-28fa-4025-a978-32d303f4c64e", "ref-fq-name": ["juniper-vqfx-10000"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:52.217 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-62ae1550-2502-4e75-9770-b00584ec14f9', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 00:46:52.281 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "hardware", "ref-uuid": "a0c59ea3-4f54-4802-a16e-0f0fe5a9f6c4", "ref-fq-name": ["juniper-mx80"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:52.295 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-149ef764-ed0c-4d3e-aeef-2defd5aea422', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:52.357 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "hardware", "ref-uuid": "83129f9f-bd77-4851-a0fb-5540fb15e1cd", "ref-fq-name": ["juniper-mx80-48t"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:52.373 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-115c213e-ab3e-4572-9a44-772a4720d5f2', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:52.454 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "hardware", "ref-uuid": "7bf74f8d-2893-41fd-9a47-80f5ea746601", "ref-fq-name": ["juniper-mx204"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:52.470 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-08a5145f-a41e-4a13-8cc4-e77c82f7a4bb', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:52.536 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "hardware", "ref-uuid": "2f2eed46-0ff0-4f6f-8678-0161a518e93c", "ref-fq-name": ["juniper-mx240"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:52.569 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-eb91e6ca-62be-4523-bace-0390ccf26340', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:52.647 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "hardware", "ref-uuid": "169a8454-d9a0-4bff-8cea-b5bb8fefd416", "ref-fq-name": ["juniper-mx480"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:52.686 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-96e301c9-dd63-4903-a70e-c2a4255181fe', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:52.753 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "hardware", "ref-uuid": "f138b373-e53c-4a88-a147-efce32f15910", "ref-fq-name": ["juniper-mx960"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:52.769 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-6b113a1f-4f5c-4914-ada7-6a07d8d181f4', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:52.834 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "hardware", "ref-uuid": "1202c502-4699-4fa5-9319-4ee96ccbb260", "ref-fq-name": ["juniper-mx2008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:52.846 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-a1c2dce7-5f34-4c10-b13b-3bdaa70ddc90', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:52.912 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "hardware", "ref-uuid": "e1ffcf2f-19d6-41b9-bebb-363e1ac07adf", "ref-fq-name": ["juniper-mx2010"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:52.923 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-3f24e304-e4c6-4b0f-8140-dcbcfd25b399', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:52.989 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "hardware", "ref-uuid": "7eb3c5e4-3940-43bf-87f8-fc438bb7b729", "ref-fq-name": ["juniper-mx2020"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:53.002 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-35e539c4-3959-41d0-a9f6-958b24cc8c97', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:53.075 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "hardware", "ref-uuid": "4d199e21-ac62-4ac2-bb00-cf274d12b104", "ref-fq-name": ["juniper-mx10003"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:53.090 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-b30c5e36-af6d-4f41-aad4-9a250bcb1ebf', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:53.160 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "hardware", "ref-uuid": "fe12d78a-6d33-42fb-8c0f-1dbc2afa9b7f", "ref-fq-name": ["juniper-jnp10008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:53.175 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-92003d0b-1a0c-4418-b754-d70b42fcd985', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:53.238 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "hardware", "ref-uuid": "0c4138fd-cac7-4d0f-8459-7e1c76592595", "ref-fq-name": ["juniper-jnp10016"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:53.256 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-79be0492-7839-48bb-8500-f3f996ca026b', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:53.324 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "hardware", "ref-uuid": "82e414ba-e1ce-404d-b2aa-a714f67c8bbd", "ref-fq-name": ["juniper-vmx"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:53.335 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-9883ede0-9556-41fa-9a12-0dae813cf297', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:53.405 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c68998fb-53d4-4962-b30f-d5685582dd33 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "c68998fb-53d4-4962-b30f-d5685582dd33", "ref-type": "hardware", "ref-uuid": "1a84671d-00eb-4c7e-b6f6-f9e667965252", "ref-fq-name": ["juniper-srx5400"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:53.426 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-ae690333-0673-468a-83a1-8ec3151bf889', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 00:46:53.495 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c68998fb-53d4-4962-b30f-d5685582dd33 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "c68998fb-53d4-4962-b30f-d5685582dd33", "ref-type": "hardware", "ref-uuid": "f20e28ef-f538-4055-9a01-36ae40836464", "ref-fq-name": ["juniper-srx5600"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:53.509 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-dd902330-99f0-4c9b-a766-87e907796b97', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 00:46:53.576 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c68998fb-53d4-4962-b30f-d5685582dd33 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "c68998fb-53d4-4962-b30f-d5685582dd33", "ref-type": "hardware", "ref-uuid": "5f9685dd-e81d-435e-9243-0a540e51fefe", "ref-fq-name": ["juniper-srx4600"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:53.592 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-a51c6998-fffe-42b2-9317-7654719545f5', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 00:46:53.696 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c68998fb-53d4-4962-b30f-d5685582dd33 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "c68998fb-53d4-4962-b30f-d5685582dd33", "ref-type": "hardware", "ref-uuid": "71e284e2-ae77-4dba-a0d1-26e2f00f1be5", "ref-fq-name": ["juniper-srx4100"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:53.716 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-f4c3e8fb-88d3-4286-98f6-80d1cd09703e', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 00:46:53.786 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c68998fb-53d4-4962-b30f-d5685582dd33 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "c68998fb-53d4-4962-b30f-d5685582dd33", "ref-type": "hardware", "ref-uuid": "898ae40a-6c7c-4330-851b-591b6f2446c5", "ref-fq-name": ["juniper-srx1500"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:53.800 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-151843f8-0b95-4bc6-837c-670d68b25565', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 00:46:53.871 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c68998fb-53d4-4962-b30f-d5685582dd33 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "c68998fb-53d4-4962-b30f-d5685582dd33", "ref-type": "hardware", "ref-uuid": "d7c580b1-4785-41ef-a1a3-9daf18811ff2", "ref-fq-name": ["juniper-srx240h-poe"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:53.892 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-751c19a6-f43a-4e32-a18f-2d8149b968fa', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 00:46:53.958 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c68998fb-53d4-4962-b30f-d5685582dd33 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "c68998fb-53d4-4962-b30f-d5685582dd33", "ref-type": "hardware", "ref-uuid": "2422eede-293d-4dcc-ba66-dc3fd053d42a", "ref-fq-name": ["juniper-vsrx"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:53.969 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-9c4fa009-7c4c-4b3a-b462-2b0502c11693', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 00:46:54.037 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c68998fb-53d4-4962-b30f-d5685582dd33 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "c68998fb-53d4-4962-b30f-d5685582dd33", "ref-type": "hardware", "ref-uuid": "a1fc1c2f-7238-4724-8499-924183b9234c", "ref-fq-name": ["juniper-srx5800"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:54.049 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-9f4b6ffb-1ca5-4f59-8322-3ca3ba42bab1', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 00:46:54.118 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c68998fb-53d4-4962-b30f-d5685582dd33 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "c68998fb-53d4-4962-b30f-d5685582dd33", "ref-type": "hardware", "ref-uuid": "af0b9bed-4914-4202-8bda-6a3399c84450", "ref-fq-name": ["juniper-srx4200"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:54.143 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-2e2b810b-494a-45cd-aa5a-907500b10875', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 00:46:54.207 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4164eb8f-2292-46fc-a598-6109c75e61ee object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "4164eb8f-2292-46fc-a598-6109c75e61ee", "ref-type": "physical-role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:54.225 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-b6aa0f4e-5fd6-4d93-a00f-b8e6460809f1', 'type': 'node_profile', 'uuid': '4164eb8f-2292-46fc-a598-6109c75e61ee'} 03/20/2025 00:46:54.289 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4164eb8f-2292-46fc-a598-6109c75e61ee object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "4164eb8f-2292-46fc-a598-6109c75e61ee", "ref-type": "overlay-role", "ref-uuid": "e9736b6f-74c6-458f-a2b2-72bc117db9bb", "ref-fq-name": ["default-global-system-config", "erb-ucast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:54.307 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-113374ed-af35-4251-8a42-0593c9da34e3', 'type': 'node_profile', 'uuid': '4164eb8f-2292-46fc-a598-6109c75e61ee'} 03/20/2025 00:46:54.369 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "overlay-role", "ref-uuid": "e9736b6f-74c6-458f-a2b2-72bc117db9bb", "ref-fq-name": ["default-global-system-config", "erb-ucast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:54.387 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-25873d1f-4b18-44ef-8fe3-7a4109db217b', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:54.450 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9166d618-21ce-4a05-bef6-98ad00b9ff32 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "9166d618-21ce-4a05-bef6-98ad00b9ff32", "ref-type": "job_template", "ref-uuid": "a908f6a3-a363-4fa5-92db-b1acc98c6623", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:54.462 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-bd676e35-46f2-4368-83ea-8d081fb43b0e', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 00:46:54.524 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4164eb8f-2292-46fc-a598-6109c75e61ee object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "4164eb8f-2292-46fc-a598-6109c75e61ee", "ref-type": "job_template", "ref-uuid": "a908f6a3-a363-4fa5-92db-b1acc98c6623", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:54.536 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-fb59009c-6620-4b6b-8526-09cbccd00e16', 'type': 'node_profile', 'uuid': '4164eb8f-2292-46fc-a598-6109c75e61ee'} 03/20/2025 00:46:54.596 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 80bfcdb7-a052-4c12-a3ac-4c07d8f464fa object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "80bfcdb7-a052-4c12-a3ac-4c07d8f464fa", "ref-type": "job_template", "ref-uuid": "a908f6a3-a363-4fa5-92db-b1acc98c6623", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:54.619 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-fee13856-82b2-4a8a-a585-e4611f6e2704', 'type': 'node_profile', 'uuid': '80bfcdb7-a052-4c12-a3ac-4c07d8f464fa'} 03/20/2025 00:46:54.675 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 552231da-108a-4ff3-9b6c-046ffcac8f18 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5220 url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "552231da-108a-4ff3-9b6c-046ffcac8f18", "ref-type": "job_template", "ref-uuid": "a908f6a3-a363-4fa5-92db-b1acc98c6623", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:54.689 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-4327ad85-b6e5-4f40-995b-49b9763ce31f', 'type': 'node_profile', 'uuid': '552231da-108a-4ff3-9b6c-046ffcac8f18'} 03/20/2025 00:46:54.757 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4396755a-d64c-45bd-87a1-90c9032cf6bc object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k-lean url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "4396755a-d64c-45bd-87a1-90c9032cf6bc", "ref-type": "job_template", "ref-uuid": "a908f6a3-a363-4fa5-92db-b1acc98c6623", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:54.766 7fabc2246048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:54.776 7fabc2246048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:54.776 7fabc2246048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:54.776 7fabc2246048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:54.776 7fabc2246048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:54.777 7fabc2246048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:54.777 7fabc2246048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:54.777 7fabc2246048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:54.777 7fabc2246048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:54.778 7fabc2246048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:54.778 7fabc2246048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:54.778 7fabc2246048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:54.778 7fabc2246048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:46:54.778 7fabc2246048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:54.796 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'oper': 'UPDATE', 'request-id': 'req-18a76047-d90a-4783-9857-8d29887fab25', 'type': 'node_profile', 'uuid': '4396755a-d64c-45bd-87a1-90c9032cf6bc'} 03/20/2025 00:46:54.852 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = abdf3f77-b2d2-4412-949f-61dd3db2e1c1 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "abdf3f77-b2d2-4412-949f-61dd3db2e1c1", "ref-type": "job_template", "ref-uuid": "a908f6a3-a363-4fa5-92db-b1acc98c6623", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:54.875 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-bdf8fd49-2eb2-45d3-b98f-6c31d7756bdc', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 00:46:54.946 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b8524210-90b0-4ce2-9c1b-52650b85ec84 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "b8524210-90b0-4ce2-9c1b-52650b85ec84", "ref-type": "job_template", "ref-uuid": "a908f6a3-a363-4fa5-92db-b1acc98c6623", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:54.978 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-0f5f8208-b6e1-41ca-abaa-a7e91ef278f1', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 00:46:55.042 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c68998fb-53d4-4962-b30f-d5685582dd33 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "node-profile", "uuid": "c68998fb-53d4-4962-b30f-d5685582dd33", "ref-type": "job_template", "ref-uuid": "a908f6a3-a363-4fa5-92db-b1acc98c6623", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:55.068 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-0654fb22-7fd5-4c8e-9921-6c9be95edec6', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 00:46:55.138 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 233df893-e2c1-487b-b00a-013bc77ceb00 object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-1 url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "telemetry-profile", "uuid": "233df893-e2c1-487b-b00a-013bc77ceb00", "ref-type": "sflow-profile", "ref-uuid": "a1151ed8-6c19-49f0-8b9c-b893fc61179f", "ref-fq-name": ["default-domain", "default-project", "sflow-all-interfaces"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:55.174 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'oper': 'UPDATE', 'request-id': 'req-fbc91c19-39a6-4819-a682-38ea0d1bb545', 'type': 'telemetry_profile', 'uuid': '233df893-e2c1-487b-b00a-013bc77ceb00'} 03/20/2025 00:46:55.245 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 510b8761-b72d-4700-aaeb-67ddf9786d3c object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-2 url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "telemetry-profile", "uuid": "510b8761-b72d-4700-aaeb-67ddf9786d3c", "ref-type": "sflow-profile", "ref-uuid": "febd87eb-2780-47ae-834a-568424b1541f", "ref-fq-name": ["default-domain", "default-project", "sflow-fabric-interfaces"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:55.261 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'oper': 'UPDATE', 'request-id': 'req-9088428e-4600-40a7-94d2-ccdb7eb8e1f3', 'type': 'telemetry_profile', 'uuid': '510b8761-b72d-4700-aaeb-67ddf9786d3c'} 03/20/2025 00:46:55.332 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43aa9aba-ef66-4d49-a60c-349a7542015d object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-3 url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "telemetry-profile", "uuid": "43aa9aba-ef66-4d49-a60c-349a7542015d", "ref-type": "sflow-profile", "ref-uuid": "a3efa8d2-99a0-43b3-8003-2b1bdee523c6", "ref-fq-name": ["default-domain", "default-project", "sflow-access-interfaces"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:55.367 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'oper': 'UPDATE', 'request-id': 'req-051781c9-136b-4894-8848-32d44cf8a9c4', 'type': 'telemetry_profile', 'uuid': '43aa9aba-ef66-4d49-a60c-349a7542015d'} 03/20/2025 00:46:55.434 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8739b957-e63d-4482-9422-cc239a4f5c89 object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-4 url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "telemetry-profile", "uuid": "8739b957-e63d-4482-9422-cc239a4f5c89", "ref-type": "grpc-profile", "ref-uuid": "3b9ed376-0736-4fe4-8979-ae55fdd22b4b", "ref-fq-name": ["default-domain", "default-project", "grpc-default-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:55.455 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'oper': 'UPDATE', 'request-id': 'req-d9078937-e4e0-497b-ab9e-285ef08157fd', 'type': 'telemetry_profile', 'uuid': '8739b957-e63d-4482-9422-cc239a4f5c89'} 03/20/2025 00:46:55.527 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9485accd-5f23-419d-897d-2f98015c444a object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-5 url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "telemetry-profile", "uuid": "9485accd-5f23-419d-897d-2f98015c444a", "ref-type": "snmp-profile", "ref-uuid": "5c56ce01-0a73-4a1a-a4fa-8cd1f98f8584", "ref-fq-name": ["default-domain", "default-project", "snmp-default-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:55.543 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'oper': 'UPDATE', 'request-id': 'req-5c6e6346-0dcc-4f53-a83f-0eebafee2373', 'type': 'telemetry_profile', 'uuid': '9485accd-5f23-419d-897d-2f98015c444a'} 03/20/2025 00:46:55.609 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f3127827-9eb2-48e8-b84a-a51ad3adb702 object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-6 url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "telemetry-profile", "uuid": "f3127827-9eb2-48e8-b84a-a51ad3adb702", "ref-type": "netconf-profile", "ref-uuid": "6ea5b275-aa65-47c6-b142-ab44b3f2cd77", "ref-fq-name": ["default-domain", "default-project", "netconf-default-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:55.624 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'oper': 'UPDATE', 'request-id': 'req-5aac0493-ffe2-4b1a-8a5f-0f789c295165', 'type': 'telemetry_profile', 'uuid': 'f3127827-9eb2-48e8-b84a-a51ad3adb702'} 03/20/2025 00:46:55.698 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd03f171-eb0f-40a3-9686-4e88bc51db09 object_type = device_functional_group identifier_name = default-domain:default-project:L2-Server-Leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "device-functional-group", "uuid": "fd03f171-eb0f-40a3-9686-4e88bc51db09", "ref-type": "physical_role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:55.716 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-f67c2514-db17-4242-b47b-f6157962d8a9', 'type': 'device_functional_group', 'uuid': 'fd03f171-eb0f-40a3-9686-4e88bc51db09'} 03/20/2025 00:46:55.780 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22d2163e-3227-4b4a-bd9c-9b8a9ef961d1 object_type = device_functional_group identifier_name = default-domain:default-project:L3-Storage-Leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "device-functional-group", "uuid": "22d2163e-3227-4b4a-bd9c-9b8a9ef961d1", "ref-type": "physical_role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:55.801 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-00d270f1-adfe-40c2-b226-5688beced74e', 'type': 'device_functional_group', 'uuid': '22d2163e-3227-4b4a-bd9c-9b8a9ef961d1'} 03/20/2025 00:46:55.865 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 156fd638-e4cc-47cc-bc7c-bcd53b08eaae object_type = device_functional_group identifier_name = default-domain:default-project:L3-Gateway-Spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "device-functional-group", "uuid": "156fd638-e4cc-47cc-bc7c-bcd53b08eaae", "ref-type": "physical_role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:55.883 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'oper': 'UPDATE', 'request-id': 'req-347d4e5f-f6e4-4e84-af89-681a11975982', 'type': 'device_functional_group', 'uuid': '156fd638-e4cc-47cc-bc7c-bcd53b08eaae'} 03/20/2025 00:46:55.941 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 14f01305-cf08-4af9-82bd-9eb645daa4cb object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "device-functional-group", "uuid": "14f01305-cf08-4af9-82bd-9eb645daa4cb", "ref-type": "physical_role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:55.957 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'oper': 'UPDATE', 'request-id': 'req-b47da7ed-4ce8-493c-ab97-a8370bbf027e', 'type': 'device_functional_group', 'uuid': '14f01305-cf08-4af9-82bd-9eb645daa4cb'} 03/20/2025 00:46:56.026 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c297d55e-5d29-46a3-bfdd-9a05637df6fa object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "device-functional-group", "uuid": "c297d55e-5d29-46a3-bfdd-9a05637df6fa", "ref-type": "physical_role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:56.071 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'oper': 'UPDATE', 'request-id': 'req-842bbc6a-355c-42aa-a953-4bf9078b60d3', 'type': 'device_functional_group', 'uuid': 'c297d55e-5d29-46a3-bfdd-9a05637df6fa'} 03/20/2025 00:46:56.132 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 178a85e6-94ec-478d-b4d1-e0ef2a2562c6 object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "device-functional-group", "uuid": "178a85e6-94ec-478d-b4d1-e0ef2a2562c6", "ref-type": "physical_role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:56.150 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'oper': 'UPDATE', 'request-id': 'req-7e0c7c10-5c2a-4f84-833f-56d3eb269760', 'type': 'device_functional_group', 'uuid': '178a85e6-94ec-478d-b4d1-e0ef2a2562c6'} 03/20/2025 00:46:56.212 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c065af7d-7508-4dfb-90a2-d225a6a58393 object_type = device_functional_group identifier_name = default-domain:default-project:Border-Spine-in-Edge-Routed url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "device-functional-group", "uuid": "c065af7d-7508-4dfb-90a2-d225a6a58393", "ref-type": "physical_role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:56.227 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'oper': 'UPDATE', 'request-id': 'req-eb14fdb7-2401-48a6-a87c-9800c063f181', 'type': 'device_functional_group', 'uuid': 'c065af7d-7508-4dfb-90a2-d225a6a58393'} 03/20/2025 00:46:56.288 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = dfc6fee9-c402-4769-81a1-b40284cd32f4 object_type = device_functional_group identifier_name = default-domain:default-project:Border-Leaf-in-Edge-Routed url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "device-functional-group", "uuid": "dfc6fee9-c402-4769-81a1-b40284cd32f4", "ref-type": "physical_role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:56.306 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'oper': 'UPDATE', 'request-id': 'req-d09f81cb-a9e9-4c96-bfc0-afec83ad7ed1', 'type': 'device_functional_group', 'uuid': 'dfc6fee9-c402-4769-81a1-b40284cd32f4'} 03/20/2025 00:46:56.365 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 03491239-e863-4c4b-8840-e6322951d25d object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "device-functional-group", "uuid": "03491239-e863-4c4b-8840-e6322951d25d", "ref-type": "physical_role", "ref-uuid": "523a4254-b62c-4e71-bb19-0745b7bad99a", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:56.383 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-4c08b621-a97a-4f35-a929-25f5c51c1de9', 'type': 'device_functional_group', 'uuid': '03491239-e863-4c4b-8840-e6322951d25d'} 03/20/2025 00:46:56.445 7fabc273a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8e9ee7de-b53b-4d77-8e4d-f8aa2c277fc9 object_type = device_functional_group identifier_name = default-domain:default-project:Lean-Spine-with-Route-Reflector url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"type": "device-functional-group", "uuid": "8e9ee7de-b53b-4d77-8e4d-f8aa2c277fc9", "ref-type": "physical_role", "ref-uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:46:56.460 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'oper': 'UPDATE', 'request-id': 'req-3a28e0ce-2182-4c60-b9ad-53c0fa17059d', 'type': 'device_functional_group', 'uuid': '8e9ee7de-b53b-4d77-8e4d-f8aa2c277fc9'} 03/20/2025 00:46:56.554 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'obj_dict': {'display_name': '_internal_ipam_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'id_perms': {'created': '2025-03-20T00:46:56.543074', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:56.543074', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9951410123355442547, 'uuid_mslong': 11021918687221991783}}, 'ipam_subnet_method': 'user-defined-subnet', 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '98f5b8a6-3f1b-4967-8a1a-82c848d3cd73'}, 'oper': 'CREATE', 'request-id': 'req-52211435-4203-4ff0-b04b-104f2a28daa9', 'type': 'network_ipam', 'uuid': '98f5b8a6-3f1b-4967-8a1a-82c848d3cd73'} 03/20/2025 00:46:56.622 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'], 'obj_dict': {'address_allocation_mode': 'user-defined-subnet-only', 'display_name': '_internal_vn_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'], 'id_perms': {'created': '2025-03-20T00:46:56.602751', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:56.602751', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13022204932965543763, 'uuid_mslong': 9395107805084141958}}, 'is_shared': False, 'network_ipam_refs': [{'attr': {'host_routes': None, 'ipam_subnets': [{'addr_from_start': True, 'alloc_unit': 1, 'allocation_pools': [], 'created': None, 'default_gateway': 'fe80::1', 'dhcp_option_list': None, 'dhcp_relay_server': [], 'dns_nameservers': [], 'dns_server_address': 'fe80::2', 'enable_dhcp': True, 'host_routes': None, 'last_modified': None, 'subnet': {'ip_prefix': 'fe80::', 'ip_prefix_len': 64}, 'subnet_name': None, 'subnet_uuid': 'd2f9e794-0524-11f0-bf0f-fa163e963883', 'subscriber_tag': None, 'vlan_tag': None}]}, 'to': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'uuid': '98f5b8a6-3f1b-4967-8a1a-82c848d3cd73'}], 'parent_type': 'project', 'parent_uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '826220c5-748a-4986-b4b8-2a6455c02f53', 'virtual_network_network_id': 5}, 'oper': 'CREATE', 'request-id': 'req-fe087c67-f8ca-4dfd-8a99-6bce0b2c39ec', 'type': 'virtual_network', 'uuid': '826220c5-748a-4986-b4b8-2a6455c02f53'} 03/20/2025 00:46:56.622 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 03/20/2025 00:46:56.623 7fabc21d98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:56.623 7fabc21d98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:_internal_vn_ipv6_link_local elements = { address_allocation_mode : "user-defined-subnet-only"display_name : "_internal_vn_ipv6_link_local"fq_name : ["default-domain", "default-project", "_internal_vn_ipv6_link_local"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 9395107805084141958, "uuid_lslong": 13022204932965543763}, "enable": true, "created": "2025-03-20T00:46:56.602751", "last_modified": "2025-03-20T00:46:56.602751", "description": null, "user_visible": true, "creator": null}is_shared : falsenetwork_ipam_refs : [{"to": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "fe80::", "ip_prefix_len": 64}, "default_gateway": "fe80::1", "dns_server_address": "fe80::2", "subnet_uuid": "d2f9e794-0524-11f0-bf0f-fa163e963883", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": null, "alloc_unit": 1, "created": null, "last_modified": null, "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "98f5b8a6-3f1b-4967-8a1a-82c848d3cd73"}]parent_type : "project"parent_uuid : "c700359a-5c65-4147-9ad7-9ff9fd609a33"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "826220c5-748a-4986-b4b8-2a6455c02f53"virtual_network_network_id : 5 } deleted = False >> 03/20/2025 00:46:56.623 7fabc21d98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:56.693 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'obj_dict': {'display_name': '_internal_vn_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'id_perms': {'created': '2025-03-20T00:46:56.683765', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:56.683765', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9616061781076318352, 'uuid_mslong': 4119897791491294952}}, 'parent_type': 'virtual-network', 'parent_uuid': '826220c5-748a-4986-b4b8-2a6455c02f53', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '392cd136-94c1-46e8-8573-1d3de7439890'}, 'oper': 'CREATE', 'request-id': 'req-fe087c67-f8ca-4dfd-8a99-6bce0b2c39ec', 'type': 'routing_instance', 'uuid': '392cd136-94c1-46e8-8573-1d3de7439890'} 03/20/2025 00:46:56.774 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000004'], 'obj_dict': {'display_name': 'target:64512:8000004', 'fq_name': ['target:64512:8000004'], 'id_perms': {'created': '2025-03-20T00:46:56.762919', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:46:56.762919', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10169851539357194739, 'uuid_mslong': 10447949955845016483}}, 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '90fe9321-1533-4ba3-8d22-9217c5d859f3'}, 'oper': 'CREATE', 'request-id': 'req-ea589221-c8e7-426e-933b-37e92af59e28', 'type': 'route_target', 'uuid': '90fe9321-1533-4ba3-8d22-9217c5d859f3'} 03/20/2025 00:46:56.803 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'oper': 'UPDATE', 'request-id': 'req-a3cf201f-3ba4-405f-8c05-23c20050619d', 'type': 'routing_instance', 'uuid': '392cd136-94c1-46e8-8573-1d3de7439890'} 03/20/2025 00:46:58.776 7fabc2182048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:58.777 7fabc2182048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:58.778 7fabc2182048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:58.778 7fabc2182048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:58.778 7fabc2182048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:58.778 7fabc2182048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:58.778 7fabc2182048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:58.779 7fabc2182048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:58.780 7fabc2182048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:58.780 7fabc2182048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:58.780 7fabc2182048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:58.780 7fabc2182048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:58.780 7fabc2182048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:46:58.780 7fabc2182048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:02.779 7fabc21b8eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:02.780 7fabc21b8eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:02.780 7fabc21b8eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:02.780 7fabc21b8eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:02.780 7fabc21b8eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:02.780 7fabc21b8eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:02.780 7fabc21b8eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:02.781 7fabc21b8eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:02.781 7fabc21b8eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:02.781 7fabc21b8eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:02.781 7fabc21b8eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:02.781 7fabc21b8eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:02.781 7fabc21b8eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:02.781 7fabc21b8eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:06.781 7fabc2268198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:06.782 7fabc2268198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:06.782 7fabc2268198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:06.782 7fabc2268198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:06.782 7fabc2268198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:06.782 7fabc2268198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:06.782 7fabc2268198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:06.783 7fabc2268198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:06.783 7fabc2268198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:06.783 7fabc2268198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:06.783 7fabc2268198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:06.783 7fabc2268198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:06.783 7fabc2268198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:06.783 7fabc2268198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:10.783 7fabc2926978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:10.785 7fabc2926978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:10.785 7fabc2926978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:10.785 7fabc2926978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:10.785 7fabc2926978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:10.785 7fabc2926978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:10.785 7fabc2926978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:10.786 7fabc2926978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:10.786 7fabc2926978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:10.786 7fabc2926978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:10.786 7fabc2926978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:10.786 7fabc2926978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:10.786 7fabc2926978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:10.786 7fabc2926978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:14.786 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:14.787 7fabc2131eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:14.787 7fabc2131eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:14.787 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:14.787 7fabc2131eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:14.787 7fabc2131eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:14.787 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:14.788 7fabc2131eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:14.788 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:14.788 7fabc2131eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:14.788 7fabc2131eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:14.788 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:14.788 7fabc2131eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:14.788 7fabc2131eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:18.788 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:18.789 7fabc2131eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:18.790 7fabc2131eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:18.790 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:18.790 7fabc2131eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:18.790 7fabc2131eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:18.790 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:18.790 7fabc2131eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:18.790 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:18.791 7fabc2131eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:18.791 7fabc2131eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:18.791 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:18.791 7fabc2131eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:18.791 7fabc2131eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:22.791 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:22.792 7fabc2131eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:22.792 7fabc2131eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:22.792 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:22.792 7fabc2131eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:22.792 7fabc2131eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:22.793 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:22.793 7fabc2131eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:22.793 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:22.793 7fabc2131eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:22.793 7fabc2131eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:22.793 7fabc2131eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:22.793 7fabc2131eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:22.793 7fabc2131eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:26.794 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:26.795 7fabc4455b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:26.795 7fabc4455b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:26.795 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:26.795 7fabc4455b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:26.795 7fabc4455b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:26.795 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:26.795 7fabc4455b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:26.795 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:26.795 7fabc4455b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:26.796 7fabc4455b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:26.796 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:26.796 7fabc4455b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:26.796 7fabc4455b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:30.795 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:30.797 7fabc4455b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:30.797 7fabc4455b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:30.797 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:30.797 7fabc4455b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:30.797 7fabc4455b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:30.797 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:30.797 7fabc4455b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:30.797 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:30.798 7fabc4455b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:30.798 7fabc4455b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:30.798 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:30.798 7fabc4455b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:30.798 7fabc4455b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:34.798 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:34.799 7fabc4455b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:34.800 7fabc4455b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:34.800 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:34.800 7fabc4455b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:34.800 7fabc4455b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:34.800 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:34.800 7fabc4455b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:34.800 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:34.800 7fabc4455b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:34.800 7fabc4455b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:34.800 7fabc4455b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:34.801 7fabc4455b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:34.801 7fabc4455b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:38.800 7fabc2150f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:38.801 7fabc2150f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:38.801 7fabc2150f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:38.801 7fabc2150f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:38.801 7fabc2150f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:38.801 7fabc2150f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:38.801 7fabc2150f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:38.802 7fabc2150f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:38.802 7fabc2150f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:38.802 7fabc2150f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:38.802 7fabc2150f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:38.802 7fabc2150f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:38.802 7fabc2150f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:38.802 7fabc2150f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:38.864 7fabc4455b70 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2923-3 url = http://10.0.0.42:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-3"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.5", "address": "10.20.0.5", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-3"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:47:38.924 7fabc31d3f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2923-1 url = http://10.0.0.42:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.42 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-1"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.11", "address": "10.20.0.11", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-1"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:47:38.984 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-3'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.5', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.5', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-3', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-3'], 'id_perms': {'created': '2025-03-20T00:47:38.950620', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:47:38.950620', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13274624960850071091, 'uuid_mslong': 2301072442691766089}}, 'parent_type': 'routing-instance', 'parent_uuid': 'a27ba35d-5cf2-4a3a-ba99-96862116ed7d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1fef0d31-ed15-4749-b838-f111e6008e33'}, 'oper': 'CREATE', 'request-id': 'req-5b2a4729-9931-4103-a670-d4f2b0e4be58', 'type': 'bgp_router', 'uuid': '1fef0d31-ed15-4749-b838-f111e6008e33'} 03/20/2025 00:47:38.985 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 00:47:38.986 7fabc215d2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:38.986 7fabc215d2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-3 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.5", "address": "10.20.0.5", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-ansible-os-2923-3"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-3"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2301072442691766089, "uuid_lslong": 13274624960850071091}, "enable": true, "created": "2025-03-20T00:47:38.950620", "last_modified": "2025-03-20T00:47:38.950620", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "a27ba35d-5cf2-4a3a-ba99-96862116ed7d"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "1fef0d31-ed15-4749-b838-f111e6008e33" } deleted = False >> 03/20/2025 00:47:38.986 7fabc215d2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.014 7fabc2061198 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2923-2 url = http://10.0.0.42:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-2"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.23", "address": "10.20.0.23", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-2"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:47:39.044 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-1'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.11', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.11', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-1', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-1'], 'id_perms': {'created': '2025-03-20T00:47:39.023674', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:47:39.023674', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12663730660172848833, 'uuid_mslong': 6272712255286559966}}, 'parent_type': 'routing-instance', 'parent_uuid': 'a27ba35d-5cf2-4a3a-ba99-96862116ed7d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '570d268f-da98-44de-afbe-9bf0aad35ec1'}, 'oper': 'CREATE', 'request-id': 'req-f0d18837-4d42-411f-aeff-34171b07ffdd', 'type': 'bgp_router', 'uuid': '570d268f-da98-44de-afbe-9bf0aad35ec1'} 03/20/2025 00:47:39.045 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 00:47:39.054 7fabc20580f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.054 7fabc20580f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.11", "address": "10.20.0.11", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-ansible-os-2923-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 6272712255286559966, "uuid_lslong": 12663730660172848833}, "enable": true, "created": "2025-03-20T00:47:39.023674", "last_modified": "2025-03-20T00:47:39.023674", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "a27ba35d-5cf2-4a3a-ba99-96862116ed7d"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "570d268f-da98-44de-afbe-9bf0aad35ec1" } deleted = False >> 03/20/2025 00:47:39.054 7fabc20580f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.137 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-2'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.23', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.23', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-2', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-2'], 'id_perms': {'created': '2025-03-20T00:47:39.095857', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:47:39.095857', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11953260708022157541, 'uuid_mslong': 18309265485222793157}}, 'parent_type': 'routing-instance', 'parent_uuid': 'a27ba35d-5cf2-4a3a-ba99-96862116ed7d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fe1793f3-c106-4fc5-a5e2-8348694b80e5'}, 'oper': 'CREATE', 'request-id': 'req-60e48151-5c9d-4b7d-801f-c59df8d55d91', 'type': 'bgp_router', 'uuid': 'fe1793f3-c106-4fc5-a5e2-8348694b80e5'} 03/20/2025 00:47:39.139 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 00:47:39.140 7fabc2052eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.146 7fabc2052eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.23", "address": "10.20.0.23", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-ansible-os-2923-2"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-2"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 18309265485222793157, "uuid_lslong": 11953260708022157541}, "enable": true, "created": "2025-03-20T00:47:39.095857", "last_modified": "2025-03-20T00:47:39.095857", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "a27ba35d-5cf2-4a3a-ba99-96862116ed7d"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "fe1793f3-c106-4fc5-a5e2-8348694b80e5" } deleted = False >> 03/20/2025 00:47:39.146 7fabc2052eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.178 7fabc4455b70 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "ref-uuid": "1fef0d31-ed15-4749-b838-f111e6008e33"} domain = default-domain project = admin user = admin >> 03/20/2025 00:47:39.235 7fabc4455b70 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "ref-type": "bgp-router", "ref-uuid": "1fef0d31-ed15-4749-b838-f111e6008e33", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-3"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:47:39.267 7fabc31d3f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.42 body = {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "ref-uuid": "570d268f-da98-44de-afbe-9bf0aad35ec1"} domain = default-domain project = admin user = admin >> 03/20/2025 00:47:39.277 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-8e9f43fa-4138-450d-a9f7-01e0a52da2e2', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 00:47:39.314 7fabc2061198 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "ref-uuid": "fe1793f3-c106-4fc5-a5e2-8348694b80e5"} domain = default-domain project = admin user = admin >> 03/20/2025 00:47:39.329 7fabc31d3f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.42 body = {"type": "global-system-config", "uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "ref-type": "bgp-router", "ref-uuid": "570d268f-da98-44de-afbe-9bf0aad35ec1", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-1"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:47:39.373 7fabc2061198 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "ref-type": "bgp-router", "ref-uuid": "fe1793f3-c106-4fc5-a5e2-8348694b80e5", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-2"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 03/20/2025 00:47:39.374 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-7c2f01fa-954b-499d-a1a0-0cb4416898ef', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 00:47:39.405 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-e1386862-a411-4f91-99ad-2e35acc12cbd', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 00:47:39.555 7fabc231cd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 570d268f-da98-44de-afbe-9bf0aad35ec1 object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2923-1 url = http://10.0.0.42:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/usr/bin/contrail-schema remote_ip = 10.0.0.47 body = {"type": "bgp-router", "uuid": "570d268f-da98-44de-afbe-9bf0aad35ec1", "ref-type": "bgp-router", "ref-uuid": null, "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-3"], "operation": "ADD", "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}} domain = default-domain project = admin user = admin >> 03/20/2025 00:47:39.583 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-1'], 'oper': 'UPDATE', 'request-id': 'req-acc6521f-55bb-48e6-99ff-0ec7014c6fbf', 'type': 'bgp_router', 'uuid': '570d268f-da98-44de-afbe-9bf0aad35ec1'} 03/20/2025 00:47:39.595 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-3'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-acc6521f-55bb-48e6-99ff-0ec7014c6fbf', 'type': 'bgp_router', 'uuid': '1fef0d31-ed15-4749-b838-f111e6008e33'} 03/20/2025 00:47:39.595 7fabc227b438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.596 7fabc227b438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.11", "address": "10.20.0.11", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "1fef0d31-ed15-4749-b838-f111e6008e33"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2923-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 6272712255286559966, "uuid_lslong": 12663730660172848833}, "enable": true, "created": "2025-03-20T00:47:39.023674", "last_modified": "2025-03-20T00:47:39.572649", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "a27ba35d-5cf2-4a3a-ba99-96862116ed7d"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "570d268f-da98-44de-afbe-9bf0aad35ec1" } deleted = False >> 03/20/2025 00:47:39.596 7fabc227b438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.600 7fabc2220d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.600 7fabc2220d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-3 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.5", "address": "10.20.0.5", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-1"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "570d268f-da98-44de-afbe-9bf0aad35ec1"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2923-3"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-3"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2301072442691766089, "uuid_lslong": 13274624960850071091}, "enable": true, "created": "2025-03-20T00:47:38.950620", "last_modified": "2025-03-20T00:47:39.569559", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "a27ba35d-5cf2-4a3a-ba99-96862116ed7d"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "1fef0d31-ed15-4749-b838-f111e6008e33" } deleted = False >> 03/20/2025 00:47:39.600 7fabc2220d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.674 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-2'], 'oper': 'UPDATE', 'request-id': 'req-62ca6847-99ce-4f5a-bd5b-80796fac54c0', 'type': 'bgp_router', 'uuid': 'fe1793f3-c106-4fc5-a5e2-8348694b80e5'} 03/20/2025 00:47:39.682 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-1'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-62ca6847-99ce-4f5a-bd5b-80796fac54c0', 'type': 'bgp_router', 'uuid': '570d268f-da98-44de-afbe-9bf0aad35ec1'} 03/20/2025 00:47:39.683 7fabc2061f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.683 7fabc2061f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.23", "address": "10.20.0.23", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-1"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "570d268f-da98-44de-afbe-9bf0aad35ec1"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2923-2"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-2"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 18309265485222793157, "uuid_lslong": 11953260708022157541}, "enable": true, "created": "2025-03-20T00:47:39.095857", "last_modified": "2025-03-20T00:47:39.660598", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "a27ba35d-5cf2-4a3a-ba99-96862116ed7d"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "fe1793f3-c106-4fc5-a5e2-8348694b80e5" } deleted = False >> 03/20/2025 00:47:39.683 7fabc2061f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.688 7fabc22bceb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.688 7fabc22bceb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.11", "address": "10.20.0.11", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "1fef0d31-ed15-4749-b838-f111e6008e33"}, {"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-2"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "fe1793f3-c106-4fc5-a5e2-8348694b80e5"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2923-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 6272712255286559966, "uuid_lslong": 12663730660172848833}, "enable": true, "created": "2025-03-20T00:47:39.023674", "last_modified": "2025-03-20T00:47:39.657933", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "a27ba35d-5cf2-4a3a-ba99-96862116ed7d"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "570d268f-da98-44de-afbe-9bf0aad35ec1" } deleted = False >> 03/20/2025 00:47:39.688 7fabc22bceb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.714 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-2'], 'oper': 'UPDATE', 'request-id': 'req-2a511668-a7be-48f9-b84c-961c794c803a', 'type': 'bgp_router', 'uuid': 'fe1793f3-c106-4fc5-a5e2-8348694b80e5'} 03/20/2025 00:47:39.725 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-3'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-2a511668-a7be-48f9-b84c-961c794c803a', 'type': 'bgp_router', 'uuid': '1fef0d31-ed15-4749-b838-f111e6008e33'} 03/20/2025 00:47:39.726 7fabc2165eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.726 7fabc2165eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.23", "address": "10.20.0.23", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "1fef0d31-ed15-4749-b838-f111e6008e33"}, {"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-1"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "570d268f-da98-44de-afbe-9bf0aad35ec1"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2923-2"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-2"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 18309265485222793157, "uuid_lslong": 11953260708022157541}, "enable": true, "created": "2025-03-20T00:47:39.095857", "last_modified": "2025-03-20T00:47:39.702718", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "a27ba35d-5cf2-4a3a-ba99-96862116ed7d"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "fe1793f3-c106-4fc5-a5e2-8348694b80e5" } deleted = False >> 03/20/2025 00:47:39.726 7fabc2165eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.734 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.734 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-3 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.5", "address": "10.20.0.5", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-1"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "570d268f-da98-44de-afbe-9bf0aad35ec1"}, {"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-2"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "fe1793f3-c106-4fc5-a5e2-8348694b80e5"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2923-3"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2923-3"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2301072442691766089, "uuid_lslong": 13274624960850071091}, "enable": true, "created": "2025-03-20T00:47:38.950620", "last_modified": "2025-03-20T00:47:39.700885", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "a27ba35d-5cf2-4a3a-ba99-96862116ed7d"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "1fef0d31-ed15-4749-b838-f111e6008e33" } deleted = False >> 03/20/2025 00:47:39.734 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:42.801 7fabc201b780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:42.803 7fabc201b780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:42.803 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:42.803 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:42.803 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:42.804 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:42.804 7fabc201b780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:42.804 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:42.804 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:42.804 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:42.804 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:42.804 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:42.804 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:42.804 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:46.804 7fabc201b780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:46.805 7fabc201b780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:46.806 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:46.806 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:46.806 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:46.806 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:46.806 7fabc201b780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:46.806 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:46.806 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:46.806 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:46.806 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:46.806 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:46.807 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:46.807 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:50.806 7fabc201b780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:50.807 7fabc201b780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:50.807 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:50.807 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:50.807 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:50.807 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:50.807 7fabc201b780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:50.808 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:50.808 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:50.808 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:50.808 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:50.808 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:50.808 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:50.808 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:54.807 7fabc201b780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:54.808 7fabc201b780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:54.808 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:54.809 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:54.809 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:54.809 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:54.809 7fabc201b780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:54.809 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:54.809 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:54.809 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:54.809 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:54.809 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:54.809 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:54.809 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:58.809 7fabc201b780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:58.810 7fabc201b780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:58.810 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:58.810 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:58.810 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:58.811 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:58.811 7fabc201b780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:58.811 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:58.811 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:58.811 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:58.811 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:58.811 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:58.811 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:58.811 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:02.811 7fabc201b780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:02.812 7fabc201b780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:02.812 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:02.813 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:02.813 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:02.813 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:02.813 7fabc201b780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:02.813 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:02.813 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:02.813 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:02.813 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:02.813 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:02.814 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:02.814 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:06.813 7fabc201b780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:06.815 7fabc201b780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:06.815 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:06.815 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:06.815 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:06.815 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:06.815 7fabc201b780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:06.815 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:06.816 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:06.816 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:06.816 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:06.816 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:06.816 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:06.816 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:10.816 7fabc201b780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:10.819 7fabc201b780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:10.819 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:10.819 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:10.819 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:10.819 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:10.819 7fabc201b780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:10.820 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:10.820 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:10.820 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:10.820 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:10.820 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:10.820 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:10.820 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:14.819 7fabc201b780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:14.820 7fabc201b780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:14.821 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:14.821 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:14.821 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:14.821 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:14.821 7fabc201b780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:14.821 7fabc201b780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:14.821 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:14.821 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:14.821 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:14.821 7fabc201b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:14.822 7fabc201b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:14.822 7fabc201b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:18.822 7fabc2897390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:18.823 7fabc2897390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:18.823 7fabc2897390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:18.823 7fabc2897390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:18.824 7fabc2897390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:18.824 7fabc2897390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:18.824 7fabc2897390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:18.824 7fabc2897390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:18.824 7fabc2897390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:18.824 7fabc2897390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:18.824 7fabc2897390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:18.824 7fabc2897390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:18.824 7fabc2897390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:18.824 7fabc2897390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:22.824 7fabc26dbf60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:22.826 7fabc26dbf60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:22.826 7fabc26dbf60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:22.826 7fabc26dbf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:22.826 7fabc26dbf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:22.826 7fabc26dbf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:22.826 7fabc26dbf60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:22.827 7fabc26dbf60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:22.827 7fabc26dbf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:22.827 7fabc26dbf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:22.827 7fabc26dbf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:22.827 7fabc26dbf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:22.827 7fabc26dbf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:22.827 7fabc26dbf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:26.827 7fabc5775240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:26.828 7fabc5775240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:26.828 7fabc5775240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:26.828 7fabc5775240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:26.828 7fabc5775240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:26.828 7fabc5775240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:26.828 7fabc5775240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:26.829 7fabc5775240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:26.829 7fabc5775240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:26.829 7fabc5775240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:26.829 7fabc5775240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:26.829 7fabc5775240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:26.829 7fabc5775240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:26.829 7fabc5775240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:30.828 7fabc5775240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:30.830 7fabc5775240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:30.830 7fabc5775240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:30.830 7fabc5775240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:30.830 7fabc5775240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:30.830 7fabc5775240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:30.830 7fabc5775240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:30.830 7fabc5775240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:30.831 7fabc5775240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:30.831 7fabc5775240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:30.831 7fabc5775240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:30.831 7fabc5775240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:30.831 7fabc5775240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:30.831 7fabc5775240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:34.831 7fabc5775240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:34.833 7fabc5775240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:34.833 7fabc5775240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:34.833 7fabc5775240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:34.833 7fabc5775240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:34.833 7fabc5775240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:34.833 7fabc5775240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:34.834 7fabc5775240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:34.834 7fabc5775240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:34.834 7fabc5775240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:34.834 7fabc5775240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:34.834 7fabc5775240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:34.834 7fabc5775240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:34.834 7fabc5775240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:37.115 7fabc5775240 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-3. url = http://10.0.0.42:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.47 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-3."], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.47", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-3."}} domain = default-domain project = admin user = admin >> 03/20/2025 00:48:37.168 7fabc2941c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-2. url = http://10.0.0.42:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-2."], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.12", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-2."}} domain = default-domain project = admin user = admin >> 03/20/2025 00:48:37.209 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-3.'], 'obj_dict': {'database_node_ip_address': '10.0.0.47', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-3.'], 'id_perms': {'created': '2025-03-20T00:48:37.183071', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:48:37.183071', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13640881405911367670, 'uuid_mslong': 3030180836561407535}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2a0d5d6a-9070-4e2f-bd4e-255dbe93fff6'}, 'oper': 'CREATE', 'request-id': 'req-cb2fe499-f92e-4f2e-bc7c-9c2dedc5cd19', 'type': 'database_node', 'uuid': '2a0d5d6a-9070-4e2f-bd4e-255dbe93fff6'} 03/20/2025 00:48:37.212 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 03/20/2025 00:48:37.213 7fabc21e1048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:37.213 7fabc21e1048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-3. elements = { database_node_ip_address : "10.0.0.47"display_name : "cn-jenkins-deploy-platform-ansible-os-2923-3."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-3."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3030180836561407535, "uuid_lslong": 13640881405911367670}, "enable": true, "created": "2025-03-20T00:48:37.183071", "last_modified": "2025-03-20T00:48:37.183071", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "92e769a6-5754-45f5-bd68-145125efbf0e"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "2a0d5d6a-9070-4e2f-bd4e-255dbe93fff6" } deleted = False >> 03/20/2025 00:48:37.213 7fabc21e1048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:37.254 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-2.'], 'obj_dict': {'database_node_ip_address': '10.0.0.12', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-2.'], 'id_perms': {'created': '2025-03-20T00:48:37.229836', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:48:37.229836', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11755233971675740796, 'uuid_mslong': 3245297702601836802}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2d099d10-f1f9-4902-a322-fb03ed563a7c'}, 'oper': 'CREATE', 'request-id': 'req-de15b2ad-dc51-4a18-983e-1077f4c853b2', 'type': 'database_node', 'uuid': '2d099d10-f1f9-4902-a322-fb03ed563a7c'} 03/20/2025 00:48:37.255 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 03/20/2025 00:48:37.257 7fabc2049240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:37.257 7fabc2049240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2. elements = { database_node_ip_address : "10.0.0.12"display_name : "cn-jenkins-deploy-platform-ansible-os-2923-2."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-2."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3245297702601836802, "uuid_lslong": 11755233971675740796}, "enable": true, "created": "2025-03-20T00:48:37.229836", "last_modified": "2025-03-20T00:48:37.229836", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "92e769a6-5754-45f5-bd68-145125efbf0e"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "2d099d10-f1f9-4902-a322-fb03ed563a7c" } deleted = False >> 03/20/2025 00:48:37.257 7fabc2049240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:37.268 7fabc21e6828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-1. url = http://10.0.0.42:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.42 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-1."], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.42", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-1."}} domain = default-domain project = admin user = admin >> 03/20/2025 00:48:37.337 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-1.'], 'obj_dict': {'database_node_ip_address': '10.0.0.42', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-1.'], 'id_perms': {'created': '2025-03-20T00:48:37.324100', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:48:37.324100', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12834287694014244404, 'uuid_mslong': 17976374462402216555}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f978e954-a4e3-426b-b21c-8ca8a2e2e634'}, 'oper': 'CREATE', 'request-id': 'req-a3532bb0-c6aa-4be7-9d94-0fda2a74ad53', 'type': 'database_node', 'uuid': 'f978e954-a4e3-426b-b21c-8ca8a2e2e634'} 03/20/2025 00:48:37.337 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 03/20/2025 00:48:37.338 7fabc2016d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:37.338 7fabc2016d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. elements = { database_node_ip_address : "10.0.0.42"display_name : "cn-jenkins-deploy-platform-ansible-os-2923-1."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-1."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 17976374462402216555, "uuid_lslong": 12834287694014244404}, "enable": true, "created": "2025-03-20T00:48:37.324100", "last_modified": "2025-03-20T00:48:37.324100", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "92e769a6-5754-45f5-bd68-145125efbf0e"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "f978e954-a4e3-426b-b21c-8ca8a2e2e634" } deleted = False >> 03/20/2025 00:48:37.338 7fabc2016d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:38.834 7fabc21e6828 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:38.835 7fabc21e6828 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:38.835 7fabc21e6828 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:38.835 7fabc21e6828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:38.836 7fabc21e6828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:38.836 7fabc21e6828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:38.836 7fabc21e6828 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:38.836 7fabc21e6828 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:38.836 7fabc21e6828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:38.836 7fabc21e6828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:38.836 7fabc21e6828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:38.836 7fabc21e6828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:38.836 7fabc21e6828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:38.837 7fabc21e6828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:42.836 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:42.837 7fabc20746d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:42.837 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:42.838 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:42.838 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:42.838 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:42.838 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:42.838 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:42.838 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:42.838 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:42.838 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:42.838 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:42.838 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:42.839 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:46.838 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:46.839 7fabc20746d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:46.839 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:46.839 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:46.839 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:46.839 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:46.839 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:46.840 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:46.840 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:46.840 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:46.840 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:46.840 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:46.840 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:46.840 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:50.840 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:50.841 7fabc20746d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:50.841 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:50.841 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:50.841 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:50.841 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:50.841 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:50.841 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:50.841 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:50.841 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:50.842 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:50.842 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:50.842 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:50.842 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:54.842 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:54.843 7fabc20746d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:54.843 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:54.843 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:54.843 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:54.843 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:54.843 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:54.843 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:54.844 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:54.844 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:54.844 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:54.844 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:54.844 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:54.844 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:58.844 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:58.846 7fabc20746d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:58.846 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:58.846 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:58.846 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:58.846 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:58.846 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:58.846 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:58.846 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:58.847 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:58.847 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:58.847 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:58.847 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:58.847 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:02.847 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:02.848 7fabc20746d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:02.848 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:02.848 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:02.848 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:02.848 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:02.848 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:02.849 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:02.849 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:02.849 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:02.849 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:02.849 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:02.849 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:49:02.849 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:06.849 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:06.850 7fabc20746d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:06.851 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:06.851 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:06.851 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:06.851 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:06.851 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:06.851 7fabc20746d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:06.851 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:06.852 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:06.852 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:06.852 7fabc20746d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:06.852 7fabc20746d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:49:06.852 7fabc20746d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:10.851 7fabc21654e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:10.853 7fabc21654e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:10.853 7fabc21654e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:10.853 7fabc21654e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:10.853 7fabc21654e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:10.853 7fabc21654e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:10.853 7fabc21654e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:10.853 7fabc21654e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:10.854 7fabc21654e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:10.854 7fabc21654e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:10.854 7fabc21654e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:10.854 7fabc21654e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:10.854 7fabc21654e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:49:10.854 7fabc21654e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:14.854 7fabc21654e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:14.855 7fabc21654e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:14.855 7fabc21654e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:14.855 7fabc21654e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:14.855 7fabc21654e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:14.855 7fabc21654e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:14.856 7fabc21654e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:14.856 7fabc21654e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:14.856 7fabc21654e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:14.856 7fabc21654e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:14.856 7fabc21654e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:14.856 7fabc21654e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:14.856 7fabc21654e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:49:14.856 7fabc21654e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:18.855 7fabc20d08d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:18.857 7fabc20d08d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:18.858 7fabc20d08d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:18.858 7fabc20d08d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:18.858 7fabc20d08d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:18.858 7fabc20d08d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:18.858 7fabc20d08d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:18.858 7fabc20d08d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:18.858 7fabc20d08d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:18.858 7fabc20d08d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:18.858 7fabc20d08d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:18.858 7fabc20d08d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:18.859 7fabc20d08d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:49:18.859 7fabc20d08d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:22.859 7fabc20d08d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:22.866 7fabc20d08d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:22.866 7fabc20d08d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:22.866 7fabc20d08d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:22.866 7fabc20d08d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:22.866 7fabc20d08d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:22.866 7fabc20d08d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:22.866 7fabc20d08d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:22.867 7fabc20d08d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:22.867 7fabc20d08d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:22.867 7fabc20d08d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:22.867 7fabc20d08d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:22.867 7fabc20d08d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:49:22.867 7fabc20d08d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:26.866 7fabc1ec8048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:26.867 7fabc1ec8048 [contrail-api] [INFO]: Session Event: TCP Connected 03/20/2025 00:49:26.867 7fabc1ec8048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:26.867 7fabc1ec8048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:26.867 7fabc1ec8048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:26.867 7fabc1ec8048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:26.867 7fabc1ec8048 [contrail-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 00:49:26.867 7fabc1ec8048 [contrail-api] [DEBUG]: Send sandesh control message. uve type count # 19 03/20/2025 00:49:26.868 7fabc1ec8048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 00:49:26.868 7fabc1ec8048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 00:49:26.868 7fabc1ec8048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 00:49:26.868 7fabc2287c18 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 00:49:26.869 7fabc2287c18 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 00:49:28.198 7fabc2040b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-2. url = http://10.0.0.42:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-2."], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.12", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-2."}} domain = default-domain project = admin user = admin >> 03/20/2025 00:49:28.264 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.12', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-2.'], 'id_perms': {'created': '2025-03-20T00:49:28.231460', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:49:28.231460', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11672651625846619010, 'uuid_mslong': 11061318134347023244}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9981b23c-e157-438c-a1fd-96cf31793b82'}, 'oper': 'CREATE', 'request-id': 'req-10a978aa-b68b-462e-9664-e8a54ae0d277', 'type': 'analytics_node', 'uuid': '9981b23c-e157-438c-a1fd-96cf31793b82'} 03/20/2025 00:49:28.267 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 03/20/2025 00:49:28.269 7fabc222d2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 00:49:28.302 7fabc225e438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-1. url = http://10.0.0.42:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.42 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-1."], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.42", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-1."}} domain = default-domain project = admin user = admin >> 03/20/2025 00:49:28.351 7fabc1e6d0f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-3. url = http://10.0.0.42:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.47 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-3."], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.47", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-3."}} domain = default-domain project = admin user = admin >> 03/20/2025 00:49:28.363 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.42', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-1.'], 'id_perms': {'created': '2025-03-20T00:49:28.342327', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:49:28.342327', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11271866916915666331, 'uuid_mslong': 2951203326535353567}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '28f4c7ca-1217-44df-9c6d-b73d723c5d9b'}, 'oper': 'CREATE', 'request-id': 'req-188a9cc7-7cd0-43a4-8daf-57685456e460', 'type': 'analytics_node', 'uuid': '28f4c7ca-1217-44df-9c6d-b73d723c5d9b'} 03/20/2025 00:49:28.364 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 03/20/2025 00:49:28.364 7fabc1e6d0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 00:49:28.448 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.47', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-3.'], 'id_perms': {'created': '2025-03-20T00:49:28.423018', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:49:28.423018', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11338432313094054592, 'uuid_mslong': 2586010924020680352}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '23e35b3b-ef88-46a0-9d5a-341d7bc822c0'}, 'oper': 'CREATE', 'request-id': 'req-40f4421b-09e6-4058-aac6-9fee94b0c38f', 'type': 'analytics_node', 'uuid': '23e35b3b-ef88-46a0-9d5a-341d7bc822c0'} 03/20/2025 00:49:28.448 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 03/20/2025 00:49:28.449 7fabc2124390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 00:49:38.012 7fabc220e978 [contrail-api] [ERROR]: Session Event: TCP Connection Closed 03/20/2025 00:49:38.012 7fabc2926978 [contrail-api] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 03/20/2025 00:49:38.013 7fabc2926978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 03/20/2025 00:49:38.013 7fabc2926978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:38.013 7fabc2926978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 03/20/2025 00:49:38.013 7fabc2926978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:38.013 7fabc2926978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:38.013 7fabc2926978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:49:38.013 7fabc2926978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:42.013 7fabc2926978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:42.015 7fabc2926978 [contrail-api] [INFO]: Session Event: TCP Connected 03/20/2025 00:49:42.015 7fabc2926978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:42.015 7fabc2926978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:42.015 7fabc2926978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:42.015 7fabc2926978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:42.015 7fabc2926978 [contrail-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 00:49:42.015 7fabc2926978 [contrail-api] [DEBUG]: Send sandesh control message. uve type count # 19 03/20/2025 00:49:42.016 7fabc2926978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 00:49:42.016 7fabc2926978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 00:49:42.016 7fabc2926978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 00:49:42.016 7fabc21b8240 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 00:49:42.016 7fabc21b8240 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 00:49:42.019 7fabcc4a3240 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001017 03/20/2025 00:49:42.019 7fabcc4a3240 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 00:49:42.020 7fabc2287f60 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 00:49:42.020 7fabc2287f60 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 00:49:42.020 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 03/20/2025 00:49:42.020 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 03/20/2025 00:49:42.020 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 00:49:42.020 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 03/20/2025 00:49:42.020 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectProjectTable:ContrailConfigTrace] map 03/20/2025 00:49:42.020 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:49:42.020 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:49:42.020 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:49:42.021 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:49:42.021 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:49:42.021 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:49:42.021 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:49:42.021 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 03/20/2025 00:49:42.021 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 00:49:42.021 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 00:49:42.021 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 00:49:42.021 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 03/20/2025 00:49:42.021 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 03/20/2025 00:49:42.021 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 03/20/2025 00:49:42.021 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 03/20/2025 00:49:42.021 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 03/20/2025 00:49:42.021 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 03/20/2025 00:49:42.022 7fabc2287f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 00:49:42.022 7fabc2287f60 [contrail-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 00:49:42.022 7fabc2287c18 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 00:49:42.025 7fabc2287c18 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 00:49:42.026 7fabc1f14cc0 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 00:49:42.037 7fabc1f14cc0 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 00:49:48.538 7fabc21312e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-1. url = http://10.0.0.42:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.42 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-1."], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.42", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-1."}} domain = default-domain project = admin user = admin >> 03/20/2025 00:49:48.555 7fabc1ec7630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-2. url = http://10.0.0.42:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-2."], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.12", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-2."}} domain = default-domain project = admin user = admin >> 03/20/2025 00:49:48.591 7fabc1ed44e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-3. url = http://10.0.0.42:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.47 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-3."], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.47", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-3."}} domain = default-domain project = admin user = admin >> 03/20/2025 00:49:48.635 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.42', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-1.'], 'id_perms': {'created': '2025-03-20T00:49:48.605380', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:49:48.605380', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13658454429170963811, 'uuid_mslong': 4565978857557151589}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3f5d9d94-50a3-4f65-bd8c-93f00f989563'}, 'oper': 'CREATE', 'request-id': 'req-530ea9f4-208f-4297-93ee-eb15dece8567', 'type': 'analytics_alarm_node', 'uuid': '3f5d9d94-50a3-4f65-bd8c-93f00f989563'} 03/20/2025 00:49:48.636 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 03/20/2025 00:49:48.711 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.12', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-2.'], 'id_perms': {'created': '2025-03-20T00:49:48.681609', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:49:48.681609', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12401597909814865341, 'uuid_mslong': 4006576900372647049}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '379a3876-8fff-4c89-ac1b-5397adbdedbd'}, 'oper': 'CREATE', 'request-id': 'req-63fd8c15-0cf7-479d-90ef-1d5aa999f8f1', 'type': 'analytics_alarm_node', 'uuid': '379a3876-8fff-4c89-ac1b-5397adbdedbd'} 03/20/2025 00:49:48.712 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 03/20/2025 00:49:48.743 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.47', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-3.'], 'id_perms': {'created': '2025-03-20T00:49:48.730673', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:49:48.730673', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10925185346693394117, 'uuid_mslong': 16581986432498288668}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e61f0cce-2368-481c-979e-0e304ef66ec5'}, 'oper': 'CREATE', 'request-id': 'req-5e922a80-8bbd-470a-82dd-99ac6d8bcf22', 'type': 'analytics_alarm_node', 'uuid': 'e61f0cce-2368-481c-979e-0e304ef66ec5'} 03/20/2025 00:49:48.745 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 03/20/2025 00:49:50.817 7fabcc4a3240 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001716 03/20/2025 00:49:50.818 7fabcc4a3240 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 00:49:50.818 7fabc212e048 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 03/20/2025 00:49:50.819 7fabc212e048 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 5 03/20/2025 00:49:50.819 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 03/20/2025 00:49:50.819 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 03/20/2025 00:49:50.819 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 00:49:50.819 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 03/20/2025 00:49:50.819 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectProjectTable:ContrailConfigTrace] map 03/20/2025 00:49:50.819 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:49:50.819 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:49:50.819 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:49:50.819 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:49:50.819 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:49:50.819 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:49:50.819 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 00:49:50.820 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 03/20/2025 00:49:50.820 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 00:49:50.820 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 00:49:50.820 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 00:49:50.820 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 03/20/2025 00:49:50.820 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 03/20/2025 00:49:50.820 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 03/20/2025 00:49:50.820 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 03/20/2025 00:49:50.820 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 03/20/2025 00:49:50.820 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 03/20/2025 00:49:50.820 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 03/20/2025 00:49:50.820 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 03/20/2025 00:49:50.821 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 03/20/2025 00:49:50.821 7fabc212e048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 00:49:50.821 7fabc2169eb8 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 00:49:50.833 7fabc2169eb8 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 00:49:50.834 7fabc1e6d6d8 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 00:49:50.836 7fabc1e6d6d8 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 00:50:02.704 7fabc2247438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-2. url = http://10.0.0.42:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-2."], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.12", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-2."}} domain = default-domain project = admin user = admin >> 03/20/2025 00:50:02.764 7fabc20f6828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-3. url = http://10.0.0.42:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.47 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-3."], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.47", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-3."}} domain = default-domain project = admin user = admin >> 03/20/2025 00:50:02.806 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.12', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-2.'], 'id_perms': {'created': '2025-03-20T00:50:02.777415', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:50:02.777415', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10617362835679415336, 'uuid_mslong': 11882705669797989828}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a4e7d9d9-72d4-4dc4-9358-733ef01b0c28'}, 'oper': 'CREATE', 'request-id': 'req-802d163d-5e8a-4aa1-961f-ea58a5e17404', 'type': 'analytics_snmp_node', 'uuid': 'a4e7d9d9-72d4-4dc4-9358-733ef01b0c28'} 03/20/2025 00:50:02.818 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 03/20/2025 00:50:02.860 7fabc2247a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-1. url = http://10.0.0.42:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.42 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2923-1."], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.42", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2923-1."}} domain = default-domain project = admin user = admin >> 03/20/2025 00:50:02.925 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.47', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-3.'], 'id_perms': {'created': '2025-03-20T00:50:02.886669', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:50:02.886669', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13232706780590423501, 'uuid_mslong': 10112174715567752156}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8c55a953-c41a-43dc-b7a4-04b501febdcd'}, 'oper': 'CREATE', 'request-id': 'req-2a267fa5-c990-4ec2-9228-42e704a4e9c2', 'type': 'analytics_snmp_node', 'uuid': '8c55a953-c41a-43dc-b7a4-04b501febdcd'} 03/20/2025 00:50:02.926 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 03/20/2025 00:50:02.960 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.42', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2923-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2923-1.'], 'id_perms': {'created': '2025-03-20T00:50:02.941273', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:50:02.941273', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9728461416749403925, 'uuid_mslong': 5487816183473718790}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4c28a3be-4097-4606-8702-701d6c710f15'}, 'oper': 'CREATE', 'request-id': 'req-b92d2174-569f-4a69-b699-eba9d330b2ee', 'type': 'analytics_snmp_node', 'uuid': '4c28a3be-4097-4606-8702-701d6c710f15'} 03/20/2025 00:50:02.961 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 03/20/2025 00:51:59.946 7fabc1e56780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/global-system-config/92e769a6-5754-45f5-bd68-145125efbf0e operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"global-system-config": {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "ip_fabric_subnets": {"subnet": [{"ip_prefix": "10.20.0.0", "ip_prefix_len": 24}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:51:59.957 7fabc1e35828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/global-system-config/92e769a6-5754-45f5-bd68-145125efbf0e operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"global-system-config": {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "ip_fabric_subnets": {"subnet": [{"ip_prefix": "10.20.0.0", "ip_prefix_len": 24}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 00:51:59.967 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-984a1923-f84b-4004-b379-9cd96cece1f2', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 00:51:59.982 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-4f2b1bb3-d714-48ba-bbc7-456f6e58f1eb', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 00:52:00.064 7fabc1de6a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_router identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-2 url = http://10.0.0.42:8082/virtual-routers operation = post useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"virtual-router": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-2923-2"], "parent_type": "global-system-config", "virtual_router_dpdk_enabled": false, "virtual_router_ip_address": "10.20.0.14", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "an-jenkins-deploy-platform-ansible-os-2923-2"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:52:00.097 7fabc1de6eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_router identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-1 url = http://10.0.0.42:8082/virtual-routers operation = post useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"virtual-router": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-2923-1"], "parent_type": "global-system-config", "virtual_router_dpdk_enabled": false, "virtual_router_ip_address": "10.20.0.12", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "an-jenkins-deploy-platform-ansible-os-2923-1"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:52:00.117 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-2923-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-2'], 'id_perms': {'created': '2025-03-20T00:52:00.100651', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:52:00.100651', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13175873738772514205, 'uuid_mslong': 13685377141349435613}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bdec3a00-7762-48dd-b6da-1b5b4cef059d', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.14'}, 'oper': 'CREATE', 'request-id': 'req-d6d43db3-6d26-4f59-8c69-ed7fca1c0fcb', 'type': 'virtual_router', 'uuid': 'bdec3a00-7762-48dd-b6da-1b5b4cef059d'} 03/20/2025 00:52:00.118 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectVRouter:ContrailConfigTrace] map 03/20/2025 00:52:00.146 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-2923-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-1'], 'id_perms': {'created': '2025-03-20T00:52:00.137485', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:52:00.137485', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12676109258359580077, 'uuid_mslong': 17961036342243706285}}, 'parent_type': 'global-system-config', 'parent_uuid': '92e769a6-5754-45f5-bd68-145125efbf0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f9426b64-4151-45ad-afea-9635a69025ad', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.12'}, 'oper': 'CREATE', 'request-id': 'req-0b7cf66f-65ff-4828-8b26-affdf35cd08b', 'type': 'virtual_router', 'uuid': 'f9426b64-4151-45ad-afea-9635a69025ad'} 03/20/2025 00:52:00.147 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectVRouter:ContrailConfigTrace] map 03/20/2025 00:52:00.417 7fabc1e8ceb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-2:vhost0 url = http://10.0.0.42:8082/virtual-machine-interfaces operation = post useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"virtual-machine-interface": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-2923-2", "vhost0"], "parent_type": "virtual-router", "virtual_machine_interface_disable_policy": true, "virtual_network_refs": [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "25e81aa2-d36c-4b63-8506-67606ce5b850"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vhost0"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:52:00.447 7fabc27ee2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-1:vhost0 url = http://10.0.0.42:8082/virtual-machine-interfaces operation = post useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"virtual-machine-interface": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-2923-1", "vhost0"], "parent_type": "virtual-router", "virtual_machine_interface_disable_policy": true, "virtual_network_refs": [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "25e81aa2-d36c-4b63-8506-67606ce5b850"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vhost0"}} domain = default-domain project = admin user = admin >> 03/20/2025 00:52:00.475 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-2', 'vhost0'], 'id_perms': {'created': '2025-03-20T00:52:00.449759', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:52:00.449759', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9297926490923739149, 'uuid_mslong': 13754707928961011415}}, 'parent_type': 'virtual-router', 'parent_uuid': 'bdec3a00-7762-48dd-b6da-1b5b4cef059d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bee289fc-5ef8-4ed7-8108-dee18734280d', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:be:e2:89:fc:5e']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '25e81aa2-d36c-4b63-8506-67606ce5b850'}]}, 'oper': 'CREATE', 'request-id': 'req-1dc098ff-d058-4683-bf61-974472c54893', 'type': 'virtual_machine_interface', 'uuid': 'bee289fc-5ef8-4ed7-8108-dee18734280d'} 03/20/2025 00:52:00.476 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectVMITable:ContrailConfigTrace] map 03/20/2025 00:52:00.490 7fabc21d9c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bee289fc-5ef8-4ed7-8108-dee18734280d object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-2:vhost0 url = http://127.0.0.1/ref-update operation = ref-update domain = default-domain >> 03/20/2025 00:52:00.524 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-1dc098ff-d058-4683-bf61-974472c54893', 'type': 'virtual_machine_interface', 'uuid': 'bee289fc-5ef8-4ed7-8108-dee18734280d'} 03/20/2025 00:52:00.542 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-1', 'vhost0'], 'id_perms': {'created': '2025-03-20T00:52:00.499107', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T00:52:00.499107', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13779479366413766183, 'uuid_mslong': 11085803862912486831}}, 'parent_type': 'virtual-router', 'parent_uuid': 'f9426b64-4151-45ad-afea-9635a69025ad', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '99d8afe0-d28d-4daf-bf3a-8b7a18eace27', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:99:d8:af:e0:d2']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '25e81aa2-d36c-4b63-8506-67606ce5b850'}]}, 'oper': 'CREATE', 'request-id': 'req-33c88b99-65db-4d70-9153-30837a111f59', 'type': 'virtual_machine_interface', 'uuid': '99d8afe0-d28d-4daf-bf3a-8b7a18eace27'} 03/20/2025 00:52:00.543 7fabc2645d68 [contrail-api] [DEBUG]: Add uve in the [ObjectVMITable:ContrailConfigTrace] map 03/20/2025 00:52:00.567 7fabc202dcc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 99d8afe0-d28d-4daf-bf3a-8b7a18eace27 object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-1:vhost0 url = http://127.0.0.1/ref-update operation = ref-update domain = default-domain >> 03/20/2025 00:52:00.605 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-33c88b99-65db-4d70-9153-30837a111f59', 'type': 'virtual_machine_interface', 'uuid': '99d8afe0-d28d-4daf-bf3a-8b7a18eace27'} 03/20/2025 00:52:01.029 7fabc27ee2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = df83a9c3-866e-4ef4-8457-9d8f1ab72fe8 object_type = access_control_list identifier_name = default-domain:default-project:ip-fabric:ip-fabric url = http://10.0.0.42:8082/access-control-list/df83a9c3-866e-4ef4-8457-9d8f1ab72fe8 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/usr/bin/contrail-schema remote_ip = 10.0.0.47 body = {"access-control-list": {"uuid": "df83a9c3-866e-4ef4-8457-9d8f1ab72fe8", "access_control_list_entries": {"dynamic": false, "acl_rule": [{"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "deny", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000002", "direction": "<>"}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}]}, "access_control_list_hash": -654770664264848570}} domain = default-domain project = admin user = admin >> 03/20/2025 00:52:01.048 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-3df90d24-2981-4c26-8724-ab618b878130', 'type': 'access_control_list', 'uuid': 'df83a9c3-866e-4ef4-8457-9d8f1ab72fe8'} 03/20/2025 00:52:38.529 7fabc1e5d8d0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 03/20/2025 00:52:38.535 7fabc3d61b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 00:53:03.820 7fabc3d61b70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 03/20/2025 00:53:03.826 7fabc3d61b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 00:53:25.859 7fabc79606d8 [contrail-api] [ERROR]: Failed to resync: Unable to establish connection to http://10.0.0.42:5000/v3/domains? 03/20/2025 01:13:27.424 7fabc79606d8 [contrail-api] [ERROR]: Failed to resync: Unable to establish connection to http://10.0.0.42:5000/v3/domains? 03/20/2025 01:52:46.843 7fabcc4a3240 [contrail-api] [ERROR]: Session Event: TCP Connection Closed 03/20/2025 01:52:46.843 7fabc2046198 [contrail-api] [INFO]: Processing event[EvTcpClose] in state[Established] 03/20/2025 01:52:46.846 7fabc2046198 [contrail-api] [INFO]: Session Event: TCP Connected 03/20/2025 01:52:46.846 7fabc2046198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpClose] => State[Established] -> State[Connect] 03/20/2025 01:52:46.846 7fabc2046198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:52:46.846 7fabc2046198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = Connection to zookeeper lost. Retrying >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Zookeeper:Zookeeper[Connection to zookeeper lost. Retrying], Collector:Collector[Established to Connect on EvTcpClose] connection down >>, ] >> 03/20/2025 01:52:46.846 7fabc2046198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:52:46.846 7fabc2046198 [contrail-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:52:46.846 7fabc2046198 [contrail-api] [DEBUG]: Send sandesh control message. uve type count # 19 03/20/2025 01:52:46.847 7fabc2046198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:52:46.847 7fabc2046198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:52:46.847 7fabc2046198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:52:46.847 7fabc226e780 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:52:46.847 7fabc226e780 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:52:46.880 7fabc215d630 [contrail-api] [ERROR]: Session Event: TCP Connection Closed 03/20/2025 01:52:46.880 7fabc226e780 [contrail-api] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 03/20/2025 01:52:46.881 7fabc226e780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 03/20/2025 01:52:46.881 7fabc226e780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:46.881 7fabc226e780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = Connection to zookeeper lost. Retrying >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Zookeeper:Zookeeper[Connection to zookeeper lost. Retrying], Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 03/20/2025 01:52:46.881 7fabc226e780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:46.881 7fabc226e780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:46.881 7fabc226e780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 3 pid = 1 http_port = 8084 start_time = 1742431578688852 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.42:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 26 >> 03/20/2025 01:52:46.881 7fabc226e780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:50.881 7fabc2082b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:52:50.882 7fabc2082b70 [contrail-api] [INFO]: Session Event: TCP Connected 03/20/2025 01:52:50.885 7fabc2082b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:52:50.885 7fabc2082b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:52:50.885 7fabc2082b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = Connection to zookeeper lost. Retrying >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Zookeeper:Zookeeper[Connection to zookeeper lost. Retrying], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:52:50.885 7fabc2082b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:52:50.886 7fabc2082b70 [contrail-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:52:50.886 7fabc2082b70 [contrail-api] [DEBUG]: Send sandesh control message. uve type count # 19 03/20/2025 01:52:50.886 7fabc2082b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:52:50.886 7fabc2082b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:52:50.886 7fabc2082b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:52:50.887 7fabc14d14e0 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:52:50.887 7fabc14d14e0 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:52:50.904 7fabc14692e8 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001017 03/20/2025 01:52:50.905 7fabc14692e8 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 01:52:50.905 7fabc2082b70 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 01:52:50.905 7fabc2082b70 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 01:52:50.905 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 03/20/2025 01:52:50.905 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 03/20/2025 01:52:50.906 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 01:52:50.906 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 03/20/2025 01:52:50.906 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectProjectTable:ContrailConfigTrace] map 03/20/2025 01:52:50.906 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 01:52:50.906 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 01:52:50.906 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 01:52:50.906 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 01:52:50.906 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 01:52:50.906 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 01:52:50.906 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 03/20/2025 01:52:50.906 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 03/20/2025 01:52:50.906 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 01:52:50.906 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 01:52:50.906 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 01:52:50.907 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 03/20/2025 01:52:50.907 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 03/20/2025 01:52:50.907 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 03/20/2025 01:52:50.907 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 03/20/2025 01:52:50.907 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 03/20/2025 01:52:50.907 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 03/20/2025 01:52:50.907 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 03/20/2025 01:52:50.907 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 03/20/2025 01:52:50.907 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 03/20/2025 01:52:50.907 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 03/20/2025 01:52:50.907 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 03/20/2025 01:52:50.907 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 03/20/2025 01:52:50.909 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVRouter:ContrailConfigTrace] map 03/20/2025 01:52:50.909 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVRouter:ContrailConfigTrace] map 03/20/2025 01:52:50.909 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVMITable:ContrailConfigTrace] map 03/20/2025 01:52:50.910 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVMITable:ContrailConfigTrace] map 03/20/2025 01:52:50.910 7fabc2082b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:52:50.910 7fabc2082b70 [contrail-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 01:52:50.910 7fabc14d1e10 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:52:50.914 7fabc14d1e10 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:52:50.915 7fabc1e91588 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:52:50.928 7fabc1e91588 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:52:50.928 7fabc2052cc0 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:52:50.929 7fabc2052cc0 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:52:51.179 7fabc20e3d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:51.195 7fabc1e35588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:52.183 7fabc14d1048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:52.201 7fabc14bdc18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:52.203 7fabc142fac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:52.219 7fabc14c5048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:53.191 7fabc1ecd390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:53.201 7fabc14c5d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:53.206 7fabc27e68d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:53.209 7fabc2082b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:53.226 7fabc1458978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:53.519 7fabc14d3780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:53.537 7fabc222d240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:54.196 7fabc13d12e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:54.206 7fabc1477828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:54.212 7fabc1531828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:54.214 7fabc14c12e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:54.230 7fabc142ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:54.525 7fabc149e048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:54.543 7fabc1498978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:54.724 7fabc1484780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:55.049 7fabc20b5b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:55.088 7fabc147f0f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:55.200 7fabc13d2630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:55.211 7fabc13c16d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:55.216 7fabc1498cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:55.220 7fabc1378d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:55.235 7fabc13808d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:55.531 7fabc1371ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:55.548 7fabc1378eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:55.731 7fabc1380e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.011 7fabc13a0048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.029 7fabc13396d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.055 7fabc1380e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.095 7fabc13c1588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.206 7fabc14c14e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.217 7fabc1531eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.230 7fabc1477eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.237 7fabc1477eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.246 7fabc14dea20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.537 7fabc145fa20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.557 7fabc1e27d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.643 7fabc154ef60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.660 7fabc220e630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.681 7fabc1329f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:56.737 7fabc14698d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.018 7fabc154b438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.035 7fabc149e0f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.060 7fabc14bd2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.084 7fabc147bd68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.101 7fabc14e0198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.212 7fabc14bd438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.222 7fabc1437828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.235 7fabc1495f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.237 7fabc132a0f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.250 7fabc13436d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.543 7fabc134c828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.562 7fabc13538d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.649 7fabc13e6cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.667 7fabc135c4e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.687 7fabc12e4588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:57.747 7fabc12ed630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.026 7fabc12f66d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.040 7fabc12fe780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.065 7fabc1307828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.089 7fabc13078d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.107 7fabc1311978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.217 7fabc1318ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.227 7fabc1321b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.241 7fabc12aac18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.243 7fabc12afcc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.256 7fabc12b7d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.549 7fabc12b7e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.567 7fabc12c4eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.656 7fabc12ccf60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.672 7fabc12d8048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.692 7fabc12de0f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:58.753 7fabc1266198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.040 7fabc12c4978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.054 7fabc126cd68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.070 7fabc1277e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.109 7fabc127ff60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.112 7fabc128d048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.229 7fabc12930f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.233 7fabc129b198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.247 7fabc1277828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.250 7fabc12a0d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.265 7fabc122be10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.559 7fabc1232eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.573 7fabc123af60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.661 7fabc1247048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.678 7fabc124f0f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.698 7fabc1232630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:52:59.759 7fabc1253cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.059 7fabc125ed68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.062 7fabc11e5e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.082 7fabc11eceb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.115 7fabc11f5f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.121 7fabc1202048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.239 7fabc11ec2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.242 7fabc1208c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.253 7fabc1212cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.255 7fabc121bd68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.278 7fabc1220e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.566 7fabc11a9eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.579 7fabc11b1f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.667 7fabc122b630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.684 7fabc11bbb70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.704 7fabc11c6c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:00.764 7fabc11cecc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.064 7fabc12322e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.070 7fabc12530f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.088 7fabc12a0780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.121 7fabc1289630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.124 7fabc1277780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.244 7fabc1264978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.249 7fabc12d4eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.258 7fabc127f8d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.264 7fabc12aae10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.284 7fabc1362048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.575 7fabc146d240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.587 7fabc14c8a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.674 7fabc1557e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.692 7fabc13624e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.712 7fabc14bd048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:01.769 7fabc15006d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:02.071 7fabc154b8d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:02.076 7fabc220e438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:02.095 7fabc1ecd588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:02.126 7fabc145f8d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:02.130 7fabc154bc18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:02.249 7fabc13cf048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:02.254 7fabc14de198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:02.264 7fabc14d12e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:02.269 7fabc1339eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:02.290 7fabc1de6cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:02.581 7fabc15310f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:02.592 7fabc139f390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.42:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 03/20/2025 01:53:02.681 7fabc14c8438 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:02.721 7fabc14c8438 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:02 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:02 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:02 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:02.743 7fabc1328eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:02.743 7fabc1328eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:02.746 7fabc139fc18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:02.746 7fabc139fc18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:02.753 7fabc1328eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:02.754 7fabc139fc18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:02.784 7fabc14d3588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:02.785 7fabc14d3588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:02.921 7fabc14d3588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:02.930 7fabc139fc18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:02.936 7fabc1328eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:02.949 7fabc139fc18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:02.956 7fabc1328eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:03.010 7fabc14d3588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:03.025 7fabc139fc18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:03.038 7fabc14d3588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:03.038 7fabc1328eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:03.051 7fabc14d3588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:03.076 7fabc1431ac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:03.076 7fabc1431ac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:03.087 7fabc1378048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:03.087 7fabc1378048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:03.088 7fabc1431ac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:03.095 7fabc1378048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:03.104 7fabc1436828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:03.104 7fabc1436828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:03.118 7fabc1436828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:03.147 7fabc1483d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:03.148 7fabc1483d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:03.149 7fabc13e8cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:03.150 7fabc13e8cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:03.162 7fabc13e8cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:03.163 7fabc1483d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:03.257 7fabc151ac18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:03.257 7fabc151ac18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:03.260 7fabc1470eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:03.260 7fabc1470eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:03.267 7fabc151ac18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:03.270 7fabc2827c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:03.270 7fabc2827c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:03.278 7fabc1470eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:03.286 7fabc1495eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:03.287 7fabc1495eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:03.290 7fabc1378048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:03.291 7fabc1431ac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:03.317 7fabc14d8d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:03.317 7fabc14d8d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:03.325 7fabc2827c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:03.334 7fabc1495eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:03.381 7fabc14d8d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:03.386 7fabc1436828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:03.424 7fabc13e8cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:03.460 7fabc1431ac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:03.461 7fabc1378048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:03.461 7fabc0700d68 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:53:03.462 7fabc0700d68 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:53:03.486 7fabc1483d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:03.525 7fabc13e8cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:03.549 7fabc1436828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:03.562 7fabc151ac18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:03.596 7fabc142ff60 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:03.596 7fabc142ff60 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:03.636 7fabc13ed4e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:03.636 7fabc13ed4e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:03.665 7fabc1470eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:03.672 7fabc142ff60 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:03.687 7fabc13ed4e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:03.718 7fabc1483d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:03.720 7fabc1495eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:03.721 7fabc14d8d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:03.721 7fabc2827c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:03.750 7fabc1470eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:03.755 7fabc151ac18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:03.758 7fabc1431ac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:03.762 7fabc1378048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:03.882 7fabc14d8d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:03.883 7fabc1495eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:03.898 7fabc13e8cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:03.904 7fabc2827c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:03.908 7fabc13ed4e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:03.909 7fabc142ff60 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:03.911 7fabc1436828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:03.921 7fabc139fc18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:03.927 7fabc1483d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:03.927 7fabc139fc18 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:03.961 7fabc139fc18 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:03 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:03 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:03 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:03.968 7fabc1328eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:03.970 7fabc1328eb8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:04.023 7fabc1328eb8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'routing_instance' fq_name = ['default-domain', 'default-project', 'ip-fabric', '__default__'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='routing_instance', fq_name=['default-domain', 'default-project', 'ip-fabric', '__default__']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'routing_instance' fq_name = ['default-domain', 'default-project', 'ip-fabric', '__default__'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('routing_instance', ['default-domain', 'default-project', 'ip-fabric', '__default__']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('routing_instance', ['default-domain', 'default-project', 'ip-fabric', '__default__']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='routing_instance', fq_name=['default-domain', 'default-project', 'ip-fabric', '__default__']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain:default-project:ip-fabric:__default__' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'routing_instance'), **kwargs={'finish': 'default-domain:default-project:ip-fabric:__default__;', 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'routing_instance') kwargs = {'finish': 'default-domain:default-project:ip-fabric:__default__;', 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='routing_instance', columns=None, start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'routing_instance' columns = None start = 'default-domain:default-project:ip-fabric:__default__:' finish = 'default-domain:default-project:ip-fabric:__default__;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='routing_instance', columns=None, start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:03 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['routing_instance'], start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:03 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['routing_instance'], start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:04.035 7fabc13ed4e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:04.036 7fabc142ff60 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:04.043 7fabc1470eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:04.046 7fabc151ac18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:04.060 7fabc14d8d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:04.064 7fabc1495eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:04.071 7fabc2827c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:04.086 7fabc13ed4e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:04.107 7fabc142ff60 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:04.110 7fabc14d3588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:04.116 7fabc14d3588 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:04.147 7fabc14d3588 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:04.440 7fabc1431ac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:04.445 7fabc1378048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:04.460 7fabc13e8cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:04.468 7fabc1483d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:04.474 7fabc1436828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:04.483 7fabc1470eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:04.487 7fabc1431ac8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:04.519 7fabc1431ac8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:04.553 7fabc1378048 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:04.557 7fabc151ac18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:04.563 7fabc14d8d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:04.567 7fabc1495eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:04.568 7fabc13e8cc0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:04.600 7fabc13e8cc0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:04.606 7fabc2827c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:04.609 7fabc1483d68 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:04.643 7fabc1483d68 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:04.677 7fabc1436828 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:04.689 7fabc13ed4e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:04.694 7fabc142ff60 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:04.695 7fabc1470eb8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:04.726 7fabc1470eb8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:04.758 7fabc151ac18 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:04.791 7fabc14d8d68 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'routing_instance' fq_name = ['default-domain', 'default-project', 'ip-fabric', '__default__'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='routing_instance', fq_name=['default-domain', 'default-project', 'ip-fabric', '__default__']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'routing_instance' fq_name = ['default-domain', 'default-project', 'ip-fabric', '__default__'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('routing_instance', ['default-domain', 'default-project', 'ip-fabric', '__default__']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('routing_instance', ['default-domain', 'default-project', 'ip-fabric', '__default__']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='routing_instance', fq_name=['default-domain', 'default-project', 'ip-fabric', '__default__']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain:default-project:ip-fabric:__default__' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'routing_instance'), **kwargs={'finish': 'default-domain:default-project:ip-fabric:__default__;', 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'routing_instance') kwargs = {'finish': 'default-domain:default-project:ip-fabric:__default__;', 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='routing_instance', columns=None, start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'routing_instance' columns = None start = 'default-domain:default-project:ip-fabric:__default__:' finish = 'default-domain:default-project:ip-fabric:__default__;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='routing_instance', columns=None, start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['routing_instance'], start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['routing_instance'], start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:04.820 7fabc1495eb8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:04.851 7fabc2827c18 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:04.880 7fabc13ed4e0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:04.909 7fabc142ff60 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 12 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:04 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:12.015 7fabc20f6588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:12.015 7fabc20f6588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:12.023 7fabc20f6588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:12.083 7fabc20f6588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:12.101 7fabc20f6588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:12.123 7fabc20f6588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:12.166 7fabc20f6588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:12.168 7fabc20f6588 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:12.246 7fabc20f6588 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:12 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = functools.partial(>, 'global_system_config') args = () kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_api_stats.py in wrapper(api_server_obj=, resource_type='global_system_config', *args=(), **kwargs={}) 16 def wrapper(api_server_obj, resource_type, *args, **kwargs): 17 if api_server_obj.enable_api_stats_log is False: 18 return func(api_server_obj, resource_type, *args, **kwargs) 19 else: 20 try: func = api_server_obj = resource_type = 'global_system_config' args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in http_resource_list(self=, obj_type='global_system_config') 1733 obj_uuids, is_count, is_detail, filters, 1734 req_fields, include_shared, exclude_hrefs, 1735 pagination) 1736 # end http_resource_list 1737 pagination = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in _list_collection(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, is_count=False, is_detail=False, filters={}, req_fields=[], include_shared=False, exclude_hrefs=False, pagination={}) 4121 include_shared=include_shared, 4122 paginate_start=page_start, 4123 paginate_count=page_count) 4124 if not ok: 4125 self.config_object_error(None, None, '%ss' %(obj_type), paginate_count undefined page_count = None /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in dbe_list(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, is_count=False, filters={}, paginate_start=None, paginate_count=None, is_detail=False, field_names=[], include_shared=False) 2343 count=flat_count, filters=filters, 2344 paginate_start=paginate_start, 2345 paginate_count=paginate_count) 2346 2347 if not ok or flat_count: paginate_count = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config',), **kwargs={'back_ref_uuids': None, 'count': False, 'filters': {}, 'obj_uuids': None, 'paginate_count': None, 'paginate_start': None, 'parent_uuids': None}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config',) kwargs = {'back_ref_uuids': None, 'count': False, 'filters': {}, 'obj_uuids': None, 'paginate_count': None, 'paginate_start': None, 'parent_uuids': None} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in object_list(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, count=False, filters={}, paginate_start=None, paginate_count=None) 1005 cols = self._cassandra_driver.xget( 1006 datastore_api.OBJ_FQ_NAME_CF_NAME, '%s' %(obj_type), 1007 start=start) 1008 1009 def filter_rows_no_anchor(): start = '' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'start': ''}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in xget(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='') 245 """Like get but creates a generator that pages over the columns automatically.""" 246 return self._XGet( 247 cf_name=cf_name, key=key, columns=columns, start=start, finish=finish) 248 249 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = '' finish = '' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _XGet(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='') 825 finish=finish, 826 columns=columns, 827 _decode_json=False) 828 return six.iteritems(rows or {}) 829 _decode_json undefined /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='', _decode_json=False) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = False /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:12 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='', finish='', num_columns=None, columns=None, include_timestamp=False, decode_json=False) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config']], *append_args=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config']] append_args = ('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config']], params=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', args=[['global_system_config']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_api_stats.py", line 18, in wrapper return func(api_server_obj, resource_type, *args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 1735, in http_resource_list pagination) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4123, in _list_collection paginate_count=page_count) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2345, in dbe_list paginate_count=paginate_count) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1007, in object_list start=start) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 247, in xget cf_name=cf_name, key=key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 827, in _XGet _decode_json=False) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:12 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='', finish='', num_columns=None, columns=None, include_timestamp=False, decode_json=False) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config']], *append_args=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config']] append_args = ('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config']], params=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', args=[['global_system_config']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:15.637 7fabc2124390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:15.638 7fabc2124390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:15.639 7fabc2124390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:15.667 7fabc11cecc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:15.667 7fabc11cecc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:15.680 7fabc11cecc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:15.688 7fabc0420c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:15.688 7fabc0420c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:15.697 7fabc2124390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:15.704 7fabc0420c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:15.731 7fabc2124390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:15.781 7fabc11cecc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:15.818 7fabc0420c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:15.832 7fabc2124390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:15.846 7fabc11cecc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:15.859 7fabc0420c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:15.863 7fabc11cecc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:15.879 7fabc0420c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:15.938 7fabc2124390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:15.952 7fabc2124390 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:16.013 7fabc2124390 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:15 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:15 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 16 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:15 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:16.051 7fabc11cecc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:16.060 7fabc0420c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:16.067 7fabc11cecc0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:16.131 7fabc11cecc0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:16 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:16 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 16 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:16 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:16.195 7fabc0420c18 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:16 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:16 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 16 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:16 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:21.975 7fabb2feb780 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:21.975 7fabb2feb780 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:21.978 7fabb2feb780 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.036 7fabb27394e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.037 7fabb27394e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.039 7fabb278a8d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.039 7fabb278a8d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.044 7fabb27394e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.045 7fabb278a8d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.046 7fabb2feb780 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:22.060 7fabb2787630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.060 7fabb2787630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.105 7fabb27816d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.105 7fabb27816d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.192 7fabb2fe00f0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.193 7fabb2fe00f0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.204 7fabb2feb780 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:22.215 7fabb2787630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.220 7fabb279c630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.220 7fabb279c630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.254 7fabb2796a20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.254 7fabb2796a20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.258 7fabb27968d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.258 7fabb27968d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.262 7fabb27816d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.296 7fabb23cd780 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.296 7fabb23cd780 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.298 7fabb2fe00f0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.300 7fabb279c630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.301 7fabb2796a20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.301 7fabb27968d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.306 7fabb23cd780 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.309 7fabb27394e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:22.350 7fabb279d4e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.350 7fabb279d4e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.360 7fabb279d4e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.362 7fabb278a8d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:22.373 7fabb27394e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:22.383 7fabb2feb780 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:22.385 7fabb27984e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.386 7fabb27984e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.387 7fabb278a8d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:22.388 7fabb27984e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.600 7fabc01cf048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.600 7fabc01cf048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.602 7fabc1e6dcc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.602 7fabc1e6dcc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.604 7fabb2fe0198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.604 7fabb2fe0198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.606 7fabb27a1048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.606 7fabb27a1048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.608 7fabb27a70f0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.608 7fabb27a70f0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.623 7fabc1469b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.623 7fabc1469b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.653 7fabc20f6588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.653 7fabc20f6588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.674 7fabc01cf048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.675 7fabc1e6dcc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.675 7fabb2fe0198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.695 7fabb27a1048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.696 7fabb27a70f0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.697 7fabc1469b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.714 7fabb2784978 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.714 7fabb2784978 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.726 7fabc20f6588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.750 7fabb2fe00f0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:22.751 7fabb27968d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:22.767 7fabb26c3828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.767 7fabb26c3828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.773 7fabb27816d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:22.807 7fabb2784978 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.814 7fabc2124390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.814 7fabc2124390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.822 7fabb2787630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:22.836 7fabc0420c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.837 7fabc0420c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.847 7fabb26c3828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.850 7fabb279c630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:22.886 7fabc11cecc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:22.889 7fabc11cecc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:22.932 7fabb23cd780 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:22.935 7fabc2124390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.939 7fabc0420c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.950 7fabb2796a20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:22.957 7fabb279d4e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:22.963 7fabc11cecc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:22.978 7fabb27968d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:22.980 7fabb1a9c2e8 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:53:22.981 7fabb1a9c2e8 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:53:22.991 7fabb2fe00f0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:22.991 7fabb1aa1eb8 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:53:22.993 7fabb1aa1eb8 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:53:23.020 7fabb27816d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.047 7fabb2787630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.057 7fabb27394e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.063 7fabb27984e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:23.074 7fabb279c630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.130 7fabb23cd780 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.130 7fabb2796a20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.151 7fabb279d4e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.151 7fabc01cf048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:23.152 7fabb2fe0198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:23.328 7fabb278a8d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.342 7fabb27a1048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:23.348 7fabb27a70f0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:23.351 7fabc1e6dcc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:23.427 7fabb27984e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.468 7fabc20f6588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:23.469 7fabb2784978 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:23.507 7fabc1469b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:23.507 7fabb26c3828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:23.513 7fabc11cecc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:23.528 7fabb2fe0198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.528 7fabc01cf048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.548 7fabb27a1048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.549 7fabb27a70f0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.554 7fabc2124390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:23.554 7fabc0420c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:23.572 7fabc1e6dcc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.572 7fabb13f3630 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:53:23.573 7fabb13f3630 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:53:23.588 7fabb2784978 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.601 7fabb27968d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.607 7fabb2fe00f0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.613 7fabb26c3828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.616 7fabc20f6588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.616 7fabc11cecc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.621 7fabc2124390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.623 7fabc0420c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.626 7fabc1469b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:23.628 7fabb27816d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.630 7fabb2787630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.651 7fabb279c630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.656 7fabb23cd780 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.659 7fabb2796a20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.671 7fabb279d4e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.692 7fabb27984e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.698 7fabb2fe0198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.702 7fabc01cf048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.712 7fabb27a1048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.714 7fabb27a70f0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.715 7fabc1e6dcc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.748 7fabb2784978 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.763 7fabb26c3828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.766 7fabc20f6588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.772 7fabc11cecc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.795 7fabc0420c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.796 7fabc2124390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:23.803 7fabc1469b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:24.302 7fabb2feb780 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:24.608 7fabb27394e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:24.620 7fabb2feb780 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:24.702 7fabb2feb780 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:24 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:24 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:24 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:24.739 7fabb278a8d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:24.772 7fabb27968d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:24.779 7fabb2fe00f0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:24.822 7fabb2787630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:24.828 7fabb27816d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:24.833 7fabb27394e0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:24.903 7fabb27394e0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:24 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = functools.partial(>, 'global_system_config') args = () kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_api_stats.py in wrapper(api_server_obj=, resource_type='global_system_config', *args=(), **kwargs={}) 16 def wrapper(api_server_obj, resource_type, *args, **kwargs): 17 if api_server_obj.enable_api_stats_log is False: 18 return func(api_server_obj, resource_type, *args, **kwargs) 19 else: 20 try: func = api_server_obj = resource_type = 'global_system_config' args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in http_resource_list(self=, obj_type='global_system_config') 1733 obj_uuids, is_count, is_detail, filters, 1734 req_fields, include_shared, exclude_hrefs, 1735 pagination) 1736 # end http_resource_list 1737 pagination = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in _list_collection(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, is_count=False, is_detail=False, filters={}, req_fields=[], include_shared=False, exclude_hrefs=False, pagination={}) 4121 include_shared=include_shared, 4122 paginate_start=page_start, 4123 paginate_count=page_count) 4124 if not ok: 4125 self.config_object_error(None, None, '%ss' %(obj_type), paginate_count undefined page_count = None /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in dbe_list(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, is_count=False, filters={}, paginate_start=None, paginate_count=None, is_detail=False, field_names=[], include_shared=False) 2343 count=flat_count, filters=filters, 2344 paginate_start=paginate_start, 2345 paginate_count=paginate_count) 2346 2347 if not ok or flat_count: paginate_count = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config',), **kwargs={'back_ref_uuids': None, 'count': False, 'filters': {}, 'obj_uuids': None, 'paginate_count': None, 'paginate_start': None, 'parent_uuids': None}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config',) kwargs = {'back_ref_uuids': None, 'count': False, 'filters': {}, 'obj_uuids': None, 'paginate_count': None, 'paginate_start': None, 'parent_uuids': None} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in object_list(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, count=False, filters={}, paginate_start=None, paginate_count=None) 1005 cols = self._cassandra_driver.xget( 1006 datastore_api.OBJ_FQ_NAME_CF_NAME, '%s' %(obj_type), 1007 start=start) 1008 1009 def filter_rows_no_anchor(): start = '' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'start': ''}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in xget(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='') 245 """Like get but creates a generator that pages over the columns automatically.""" 246 return self._XGet( 247 cf_name=cf_name, key=key, columns=columns, start=start, finish=finish) 248 249 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = '' finish = '' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _XGet(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='') 825 finish=finish, 826 columns=columns, 827 _decode_json=False) 828 return six.iteritems(rows or {}) 829 _decode_json undefined /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='', _decode_json=False) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = False /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:24 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='', finish='', num_columns=None, columns=None, include_timestamp=False, decode_json=False) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config']], *append_args=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config']] append_args = ('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config']], params=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', args=[['global_system_config']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_api_stats.py", line 18, in wrapper return func(api_server_obj, resource_type, *args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 1735, in http_resource_list pagination) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4123, in _list_collection paginate_count=page_count) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2345, in dbe_list paginate_count=paginate_count) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1007, in object_list start=start) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 247, in xget cf_name=cf_name, key=key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 827, in _XGet _decode_json=False) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:24 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='', finish='', num_columns=None, columns=None, include_timestamp=False, decode_json=False) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config']], *append_args=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config']] append_args = ('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config']], params=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', args=[['global_system_config']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:24.907 7fabb279c630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:24.921 7fabb23cd780 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:24.929 7fabb2796a20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:24.941 7fabb27984e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:24.946 7fabb279d4e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:24.950 7fabb278a8d0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:25.003 7fabb278a8d0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:24 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:24 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:24 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:25.019 7fabb2fe0198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:25.028 7fabc01cf048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:25.035 7fabb27a1048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:25.048 7fabb27a70f0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:25.053 7fabc1e6dcc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:25.058 7fabb27968d0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:25.174 7fabb27968d0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:25.300 7fabb2fe00f0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:25.324 7fabb2784978 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:25.339 7fabc20f6588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:25.358 7fabc11cecc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:25.360 7fabb26c3828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:25.373 7fabc2124390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:25.382 7fabc0420c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:25.387 7fabb2787630 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:25.482 7fabb2787630 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:25.571 7fabb27816d8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:25.655 7fabb279c630 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:25.756 7fabb23cd780 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = functools.partial(>, 'global_system_config') args = () kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_api_stats.py in wrapper(api_server_obj=, resource_type='global_system_config', *args=(), **kwargs={}) 16 def wrapper(api_server_obj, resource_type, *args, **kwargs): 17 if api_server_obj.enable_api_stats_log is False: 18 return func(api_server_obj, resource_type, *args, **kwargs) 19 else: 20 try: func = api_server_obj = resource_type = 'global_system_config' args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in http_resource_list(self=, obj_type='global_system_config') 1733 obj_uuids, is_count, is_detail, filters, 1734 req_fields, include_shared, exclude_hrefs, 1735 pagination) 1736 # end http_resource_list 1737 pagination = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in _list_collection(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, is_count=False, is_detail=False, filters={}, req_fields=[], include_shared=False, exclude_hrefs=False, pagination={}) 4121 include_shared=include_shared, 4122 paginate_start=page_start, 4123 paginate_count=page_count) 4124 if not ok: 4125 self.config_object_error(None, None, '%ss' %(obj_type), paginate_count undefined page_count = None /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in dbe_list(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, is_count=False, filters={}, paginate_start=None, paginate_count=None, is_detail=False, field_names=[], include_shared=False) 2343 count=flat_count, filters=filters, 2344 paginate_start=paginate_start, 2345 paginate_count=paginate_count) 2346 2347 if not ok or flat_count: paginate_count = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config',), **kwargs={'back_ref_uuids': None, 'count': False, 'filters': {}, 'obj_uuids': None, 'paginate_count': None, 'paginate_start': None, 'parent_uuids': None}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config',) kwargs = {'back_ref_uuids': None, 'count': False, 'filters': {}, 'obj_uuids': None, 'paginate_count': None, 'paginate_start': None, 'parent_uuids': None} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in object_list(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, count=False, filters={}, paginate_start=None, paginate_count=None) 1005 cols = self._cassandra_driver.xget( 1006 datastore_api.OBJ_FQ_NAME_CF_NAME, '%s' %(obj_type), 1007 start=start) 1008 1009 def filter_rows_no_anchor(): start = '' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'start': ''}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in xget(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='') 245 """Like get but creates a generator that pages over the columns automatically.""" 246 return self._XGet( 247 cf_name=cf_name, key=key, columns=columns, start=start, finish=finish) 248 249 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = '' finish = '' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _XGet(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='') 825 finish=finish, 826 columns=columns, 827 _decode_json=False) 828 return six.iteritems(rows or {}) 829 _decode_json undefined /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='', _decode_json=False) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = False /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='', finish='', num_columns=None, columns=None, include_timestamp=False, decode_json=False) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config']], *append_args=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config']] append_args = ('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config']], params=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', args=[['global_system_config']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_api_stats.py", line 18, in wrapper return func(api_server_obj, resource_type, *args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 1735, in http_resource_list pagination) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4123, in _list_collection paginate_count=page_count) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2345, in dbe_list paginate_count=paginate_count) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1007, in object_list start=start) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 247, in xget cf_name=cf_name, key=key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 827, in _XGet _decode_json=False) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='', finish='', num_columns=None, columns=None, include_timestamp=False, decode_json=False) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config']], *append_args=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config']] append_args = ('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config']], params=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', args=[['global_system_config']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:25.859 7fabb2796a20 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:25.948 7fabb27984e0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'routing_instance' fq_name = ['default-domain', 'default-project', 'ip-fabric', '__default__'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='routing_instance', fq_name=['default-domain', 'default-project', 'ip-fabric', '__default__']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'routing_instance' fq_name = ['default-domain', 'default-project', 'ip-fabric', '__default__'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('routing_instance', ['default-domain', 'default-project', 'ip-fabric', '__default__']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('routing_instance', ['default-domain', 'default-project', 'ip-fabric', '__default__']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='routing_instance', fq_name=['default-domain', 'default-project', 'ip-fabric', '__default__']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain:default-project:ip-fabric:__default__' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'routing_instance'), **kwargs={'finish': 'default-domain:default-project:ip-fabric:__default__;', 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'routing_instance') kwargs = {'finish': 'default-domain:default-project:ip-fabric:__default__;', 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='routing_instance', columns=None, start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'routing_instance' columns = None start = 'default-domain:default-project:ip-fabric:__default__:' finish = 'default-domain:default-project:ip-fabric:__default__;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='routing_instance', columns=None, start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['routing_instance'], start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['routing_instance'], start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:26.027 7fabb279d4e0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:26.103 7fabb2fe0198 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:26.177 7fabc01cf048 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:26.264 7fabb27a1048 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:26.351 7fabb27a70f0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'routing_instance' fq_name = ['default-domain', 'default-project', 'ip-fabric', '__default__'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='routing_instance', fq_name=['default-domain', 'default-project', 'ip-fabric', '__default__']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'routing_instance' fq_name = ['default-domain', 'default-project', 'ip-fabric', '__default__'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('routing_instance', ['default-domain', 'default-project', 'ip-fabric', '__default__']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('routing_instance', ['default-domain', 'default-project', 'ip-fabric', '__default__']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='routing_instance', fq_name=['default-domain', 'default-project', 'ip-fabric', '__default__']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain:default-project:ip-fabric:__default__' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'routing_instance'), **kwargs={'finish': 'default-domain:default-project:ip-fabric:__default__;', 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'routing_instance') kwargs = {'finish': 'default-domain:default-project:ip-fabric:__default__;', 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='routing_instance', columns=None, start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'routing_instance' columns = None start = 'default-domain:default-project:ip-fabric:__default__:' finish = 'default-domain:default-project:ip-fabric:__default__;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='routing_instance', columns=None, start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['routing_instance'], start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['routing_instance'], start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:26.451 7fabc1e6dcc0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:26.600 7fabb2784978 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:26.604 7fabc1469b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:26.608 7fabc20f6588 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:26.654 7fabc20f6588 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:26.739 7fabc11cecc0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:26.818 7fabb26c3828 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:26.830 7fabc1469b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:53:26.830 7fabc1469b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:53:26.846 7fabc2124390 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 03/20/2025 01:53:26.890 7fabc2124390 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:26.936 7fabc0420c18 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 40 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Thu Mar 20 01:53:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/20/2025 01:53:26.940 7fabc1469b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:53:26.982 7fabc1469b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:53:27.006 7fabc1469b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:53:27.017 7fabc1469b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:53:27.043 7fabc1469b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:53:29.848 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-c644d79b-4bda-4a33-b6db-496a532c7036', 'type': 'application_policy_set', 'uuid': 'f045dcda-023e-429a-9f40-7ce2fc20afdb'} 03/20/2025 01:53:30.825 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-2805d4a6-e0dc-4db6-bbae-b299a8c97940', 'type': 'network_ipam', 'uuid': 'f66b4c09-0c4c-42ef-ade0-dbf25202f4b2'} 03/20/2025 01:53:30.888 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-46302931-1ea9-441f-872b-b38e56365691', 'type': 'project', 'uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33'} 03/20/2025 01:53:33.921 7fabb07766d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bdec3a00-7762-48dd-b6da-1b5b4cef059d object_type = virtual_router identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-2 url = http://10.0.0.42:8082/virtual-router/bdec3a00-7762-48dd-b6da-1b5b4cef059d operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"virtual-router": {"uuid": "bdec3a00-7762-48dd-b6da-1b5b4cef059d", "virtual_router_dpdk_enabled": false}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:33.949 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-2'], 'oper': 'UPDATE', 'request-id': 'req-6329e711-4285-41b5-9cf4-b727e9f075f8', 'type': 'virtual_router', 'uuid': 'bdec3a00-7762-48dd-b6da-1b5b4cef059d'} 03/20/2025 01:53:34.171 7fabb06ce4e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bee289fc-5ef8-4ed7-8108-dee18734280d object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-2:vhost0 url = http://10.0.0.42:8082/virtual-machine-interface/bee289fc-5ef8-4ed7-8108-dee18734280d operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"virtual-machine-interface": {"uuid": "bee289fc-5ef8-4ed7-8108-dee18734280d", "virtual_machine_interface_disable_policy": true}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:34.212 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-b27647e1-1fad-4e01-9e19-4742c85ed6c4', 'type': 'virtual_machine_interface', 'uuid': 'bee289fc-5ef8-4ed7-8108-dee18734280d'} 03/20/2025 01:53:34.387 7fabb0fef048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f9426b64-4151-45ad-afea-9635a69025ad object_type = virtual_router identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-1 url = http://10.0.0.42:8082/virtual-router/f9426b64-4151-45ad-afea-9635a69025ad operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"virtual-router": {"uuid": "f9426b64-4151-45ad-afea-9635a69025ad", "virtual_router_dpdk_enabled": false}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:34.453 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-1'], 'oper': 'UPDATE', 'request-id': 'req-e64e39b1-70af-41dd-81da-aa5558dc65ae', 'type': 'virtual_router', 'uuid': 'f9426b64-4151-45ad-afea-9635a69025ad'} 03/20/2025 01:53:34.675 7fabb06ce198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 99d8afe0-d28d-4daf-bf3a-8b7a18eace27 object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-1:vhost0 url = http://10.0.0.42:8082/virtual-machine-interface/99d8afe0-d28d-4daf-bf3a-8b7a18eace27 operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"virtual-machine-interface": {"uuid": "99d8afe0-d28d-4daf-bf3a-8b7a18eace27", "virtual_machine_interface_disable_policy": true}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:34.718 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-4abf6adf-4179-4472-b263-c004ac7263a4', 'type': 'virtual_machine_interface', 'uuid': '99d8afe0-d28d-4daf-bf3a-8b7a18eace27'} 03/20/2025 01:53:35.308 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-a8325362-af54-42bd-8a18-e775d66c2138', 'type': 'application_policy_set', 'uuid': 'f045dcda-023e-429a-9f40-7ce2fc20afdb'} 03/20/2025 01:53:35.843 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-1b3c8a84-e737-48b9-afc8-bcaee07b064b', 'type': 'project', 'uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33'} 03/20/2025 01:53:35.889 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-a0dc0715-5cb4-43cf-8353-5b54946bf846', 'type': 'network_ipam', 'uuid': 'f66b4c09-0c4c-42ef-ade0-dbf25202f4b2'} 03/20/2025 01:53:39.882 7fabc1d04d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1fef0d31-ed15-4749-b838-f111e6008e33 object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2923-3 url = http://10.0.0.42:8082/bgp-router/1fef0d31-ed15-4749-b838-f111e6008e33 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"bgp-router": {"uuid": "1fef0d31-ed15-4749-b838-f111e6008e33", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.5", "address": "10.20.0.5", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:39.953 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-3'], 'oper': 'UPDATE', 'request-id': 'req-c031831d-b891-4f86-9a98-f65bbaf8dfab', 'type': 'bgp_router', 'uuid': '1fef0d31-ed15-4749-b838-f111e6008e33'} 03/20/2025 01:53:41.760 7fabc1ca5438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fe1793f3-c106-4fc5-a5e2-8348694b80e5 object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2923-2 url = http://10.0.0.42:8082/bgp-router/fe1793f3-c106-4fc5-a5e2-8348694b80e5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"bgp-router": {"uuid": "fe1793f3-c106-4fc5-a5e2-8348694b80e5", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.23", "address": "10.20.0.23", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:41.841 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-2'], 'oper': 'UPDATE', 'request-id': 'req-3db9304b-0036-4a2c-9c79-fb164064778c', 'type': 'bgp_router', 'uuid': 'fe1793f3-c106-4fc5-a5e2-8348694b80e5'} 03/20/2025 01:53:43.481 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'image_upgrade_template'], 'oper': 'UPDATE', 'request-id': 'req-007e3aed-75d3-4c13-a502-b29754e3421d', 'type': 'job_template', 'uuid': '56e3a6e2-6b93-4897-8caa-6e63bb7c1591'} 03/20/2025 01:53:44.021 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'container_cleanup_template'], 'oper': 'UPDATE', 'request-id': 'req-84fac789-4583-48c4-b199-efe92284370f', 'type': 'job_template', 'uuid': '47a78b56-d59c-4e48-8272-5d1f7de49cdc'} 03/20/2025 01:53:44.068 7fabc20e32e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 27369b08-4630-4c29-a0e5-5627ebb58d9f object_type = job_template identifier_name = default-global-system-config:cli_sync_template url = http://10.0.0.42:8082/job-template/27369b08-4630-4c29-a0e5-5627ebb58d9f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"job-template": {"uuid": "27369b08-4630-4c29-a0e5-5627ebb58d9f", "fq_name": ["default-global-system-config", "cli_sync_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/cli_sync.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"CLI sync input\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"devices_cli\": {\"type\": \"array\", \"items\": {\"title\": \"Devices CLI Items\", \"type\": \"object\", \"description\": \"Dictionaries of device details\", \"additionalProperties\": false, \"required\": [\"device_uuid\", \"cli_objects\"], \"properties\": {\"device_uuid\": {\"type\": \"string\", \"title\": \"UUIDs of the device\"}, \"cli_objects\": {\"type\": \"array\", \"title\": \"cli objects for that device\", \"items\": {\"type\": \"object\", \"required\": [\"time\", \"status\"], \"properties\": {\"time\": {\"type\": \"string\", \"title\": \"Timestamp of the cli change\"}, \"status\": {\"type\": \"string\", \"title\": \"Accept or Reject the commit\"}}}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Sync cli config with Contrail"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:44.124 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cli_sync_template'], 'oper': 'UPDATE', 'request-id': 'req-648defbc-ec8a-4379-b828-6a5a52bfbb46', 'type': 'job_template', 'uuid': '27369b08-4630-4c29-a0e5-5627ebb58d9f'} 03/20/2025 01:53:44.257 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'hitless_upgrade_strategy_template'], 'oper': 'UPDATE', 'request-id': 'req-62a4815d-3a54-45af-a093-e293552fd3be', 'type': 'job_template', 'uuid': '71bc2d92-6b66-4d2f-b550-33e35075fed0'} 03/20/2025 01:53:44.314 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'maintenance_mode_activate_template'], 'oper': 'UPDATE', 'request-id': 'req-60597efd-2fe1-46e1-a268-c9a851625a40', 'type': 'job_template', 'uuid': '01dd473b-cd08-4d24-9ee6-fb53d70b54a7'} 03/20/2025 01:53:44.355 7fabc1ce9048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 57698a13-613c-4453-8443-36dc62d87fb1 object_type = job_template identifier_name = default-global-system-config:maintenance_mode_deactivate_template url = http://10.0.0.42:8082/job-template/57698a13-613c-4453-8443-36dc62d87fb1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"job-template": {"uuid": "57698a13-613c-4453-8443-36dc62d87fb1", "fq_name": ["default-global-system-config", "maintenance_mode_deactivate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/maintenance_mode_deactivate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Deactivate maintenance mode\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_uuid\", \"device_uuid\"], \"properties\": {\"fabric_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Fabric UUID\", \"description\": \"UUID of the device fabric\"}, \"device_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Device UUID\", \"description\": \"UUID of the device to exit maintenance mode\"}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on target device\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on peer device\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Deactivate maintenance mode output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Maintenance Mode Deactivation"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:44.399 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'maintenance_mode_deactivate_template'], 'oper': 'UPDATE', 'request-id': 'req-0796c60e-69dd-44db-b848-af2518141cd2', 'type': 'job_template', 'uuid': '57698a13-613c-4453-8443-36dc62d87fb1'} 03/20/2025 01:53:44.448 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'discover_device_template'], 'oper': 'UPDATE', 'request-id': 'req-a42ffc7f-07f1-41d4-9736-69f79b5cb9ba', 'type': 'job_template', 'uuid': '4db07ee7-6204-4524-b6bf-fe1a6b7ad0fe'} 03/20/2025 01:53:44.510 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'discover_os_computes_template'], 'oper': 'UPDATE', 'request-id': 'req-babd559d-c670-483e-9a2f-031265c71424', 'type': 'job_template', 'uuid': '1d37f514-16ed-41bc-8841-198342d6bfec'} 03/20/2025 01:53:44.536 7fabc2165eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 971ceaec-e77a-49eb-b396-d0096b4b507d object_type = job_template identifier_name = default-global-system-config:discover_role_template url = http://10.0.0.42:8082/job-template/971ceaec-e77a-49eb-b396-d0096b4b507d operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"job-template": {"uuid": "971ceaec-e77a-49eb-b396-d0096b4b507d", "fq_name": ["default-global-system-config", "discover_role_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_role.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover Role"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:44.567 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'discover_role_template'], 'oper': 'UPDATE', 'request-id': 'req-10b54757-1f32-4620-9472-f16ac0354903', 'type': 'job_template', 'uuid': '971ceaec-e77a-49eb-b396-d0096b4b507d'} 03/20/2025 01:53:44.622 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'device_import_template'], 'oper': 'UPDATE', 'request-id': 'req-7d6b9f55-3631-4bbd-98ca-8953ef863c49', 'type': 'job_template', 'uuid': 'a173d135-aa6d-4e04-bdcd-551919a4ae52'} 03/20/2025 01:53:44.676 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_config_template'], 'oper': 'UPDATE', 'request-id': 'req-63dea279-7c36-4707-a19a-171b5d2ca327', 'type': 'job_template', 'uuid': 'a908f6a3-a363-4fa5-92db-b1acc98c6623'} 03/20/2025 01:53:44.703 7fabc1d5a048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6983bea7-aef6-42f0-8b69-c0afe6a25c7f object_type = job_template identifier_name = default-global-system-config:ztp_template url = http://10.0.0.42:8082/job-template/6983bea7-aef6-42f0-8b69-c0afe6a25c7f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"job-template": {"uuid": "6983bea7-aef6-42f0-8b69-c0afe6a25c7f", "fq_name": ["default-global-system-config", "ztp_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/ztp.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"device_count\": {\"$id\": \"/properties/input/properties/device_count\", \"type\": \"integer\", \"title\": \"The Device Count Schema\", \"description\": \"Number of devices to discover\", \"default\": 0, \"examples\": [1, 2, 3, 4, 5]}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "ZTP"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:44.740 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ztp_template'], 'oper': 'UPDATE', 'request-id': 'req-5c4909cf-1fa3-48a0-9ec2-d1b533ff09a9', 'type': 'job_template', 'uuid': '6983bea7-aef6-42f0-8b69-c0afe6a25c7f'} 03/20/2025 01:53:44.842 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_deletion_template'], 'oper': 'UPDATE', 'request-id': 'req-75c6aa78-9c7a-449a-b2eb-97740466ede0', 'type': 'job_template', 'uuid': 'eb42e5f9-e101-4e26-9ad6-01c633fc3377'} 03/20/2025 01:53:44.931 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'device_deletion_template'], 'oper': 'UPDATE', 'request-id': 'req-8f92ef6a-9b1d-4434-93d1-615cd626731c', 'type': 'job_template', 'uuid': '347c86ea-e760-4c27-a2f4-30bd246a801f'} 03/20/2025 01:53:44.957 7fabb1a5bcc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d157d87d-664e-4288-bb80-8125f385b073 object_type = job_template identifier_name = default-global-system-config:role_assignment_template url = http://10.0.0.42:8082/job-template/d157d87d-664e-4288-bb80-8125f385b073 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"job-template": {"uuid": "d157d87d-664e-4288-bb80-8125f385b073", "fq_name": ["default-global-system-config", "role_assignment_template"], "parent_type": "global-system-config", "job_template_type": "config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/role_assignment.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\", \"role_assignments\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"role_assignments\": {\"type\": \"array\", \"minItems\": 0, \"description\": \"Fabric device role assignments\", \"items\": {\"type\": \"object\", \"properties\": {\"device_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"physical_role\": {\"type\": \"string\", \"enum\": [\"leaf\", \"spine\", \"pnf\", \"superspine\"]}, \"routing_switching_roles\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"enum\": [\"CRB\"]}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Role Assignment"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:44.995 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'role_assignment_template'], 'oper': 'UPDATE', 'request-id': 'req-97e46986-021a-47f4-9377-9300ffe41e6a', 'type': 'job_template', 'uuid': 'd157d87d-664e-4288-bb80-8125f385b073'} 03/20/2025 01:53:45.082 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'topology_discovery_template'], 'oper': 'UPDATE', 'request-id': 'req-703f362d-bd1d-4fbc-97c6-2d9b6382db7d', 'type': 'job_template', 'uuid': '57c9a014-e572-48c9-bf38-49282787a662'} 03/20/2025 01:53:45.178 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_onboard_template'], 'oper': 'UPDATE', 'request-id': 'req-937900c6-313d-4ac6-ad1f-23f3c09aab7a', 'type': 'job_template', 'uuid': '7d11447d-d8e3-476e-bff5-998233455a4e'} 03/20/2025 01:53:45.202 7fabb0773390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 16090e51-76d5-401e-b598-b1dc2f40e0cf object_type = job_template identifier_name = default-global-system-config:search_ip_mac_template url = http://10.0.0.42:8082/job-template/16090e51-76d5-401e-b598-b1dc2f40e0cf operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"job-template": {"uuid": "16090e51-76d5-401e-b598-b1dc2f40e0cf", "fq_name": ["default-global-system-config", "search_ip_mac_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ip_address\": {\"$id\": \"/properties/ip_address\", \"title\": \"IP Address\", \"pattern\": \"^\\\\s*(([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5]).){3}([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5])\\\\s*$\", \"type\": \"string\"}, \"mac_address\": {\"$id\": \"/properties/mac_address\", \"title\": \"Mac Address\", \"pattern\": \"^\\\\s*([A-Fa-f0-9]{2}(:{1}[A-Fa-f0-9]{2}){5})\\\\s*$\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Search ip or mac schema command Playbook Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"interface_names\": {\"type\": \"array\", \"title\": \"Interfaces Name(s)\", \"description\": \"Display Interface Names that belong to this mac_address.\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface Name\", \"description\": \"Interface name\"}, \"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"Device name on which the interface was learnt\"}, \"loopback_ip\": {\"type\": \"string\", \"title\": \"Source Loopback IP\", \"description\": \"Originating source's loopback ip address\"}}, \"description\": \"Name of each interface that belongs under this mac_address\"}}}}}}}}}", "job_template_input_ui_schema": "{\"ip_address\": {\"ui:help\": \"Enter an IP Address. The field value must include a IPv4 address without subnet mask; for example, 192.168.3.120\", \"ui:placeholder\": \"Enter IP address\"}, \"mac_address\": {\"ui:help\": \"Enter a 48 bit MAC address in colon separated format; for example, 00:00:0A:BB:28:FC\", \"ui:placeholder\": \"Enter MAC address\"}}", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to locate an interface in a fabric given an IP or MAC", "display_name": "Search using IP or MAC"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:45.295 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'search_ip_mac_template'], 'oper': 'UPDATE', 'request-id': 'req-6f3c94bd-de2d-419f-8332-0c28ed450e59', 'type': 'job_template', 'uuid': '16090e51-76d5-401e-b598-b1dc2f40e0cf'} 03/20/2025 01:53:45.350 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_interface_details_template'], 'oper': 'UPDATE', 'request-id': 'req-92dec28b-c865-43c8-8d31-ab090db1a635', 'type': 'job_template', 'uuid': '3937e9ee-4094-4c7e-a858-8aaf3a7249e7'} 03/20/2025 01:53:45.405 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_config_template'], 'oper': 'UPDATE', 'request-id': 'req-bf204767-0e40-410a-b019-cd3a625afafd', 'type': 'job_template', 'uuid': 'a0ddefa4-23bc-4484-869f-0a16f1839aff'} 03/20/2025 01:53:45.434 7fabc1cf8d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0c145fed-1bb4-4f52-a098-80eeb3bc0354 object_type = job_template identifier_name = default-global-system-config:test_overlay_connectivity_template url = http://10.0.0.42:8082/job-template/0c145fed-1bb4-4f52-a098-80eeb3bc0354 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"job-template": {"uuid": "0c145fed-1bb4-4f52-a098-80eeb3bc0354", "fq_name": ["default-global-system-config", "test_overlay_connectivity_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"source_ip\": {\"$id\": \"/properties/source_ip\", \"title\": \"Source (device loopback IP)\", \"type\": \"string\", \"default\": \"\"}, \"destination_ip\": {\"$id\": \"/properties/destination_ip\", \"title\": \"Destination (device loopback IP)\", \"type\": \"string\", \"default\": \"\"}, \"vni\": {\"$id\": \"/properties/vni\", \"title\": \"VNI\", \"type\": \"integer\", \"default\": 100}, \"count\": {\"$id\": \"/properties/count\", \"title\": \"Packet count\", \"type\": \"integer\", \"default\": 5}}, \"required\": [\"source_ip\", \"destination_ip\", \"count\", \"vni\"]}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show connectivity test report\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Each playbook's command_output for this specific command.\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Connectivity test report\", \"description\": \"Display connectivity test report\"}}}}}}}}", "job_template_input_ui_schema": "{\"destination_ip\": {\"ui:help\": \"\"}}", "job_template_output_ui_schema": "null", "job_template_description": "", "display_name": "Test overlay connectivity"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:45.509 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'test_overlay_connectivity_template'], 'oper': 'UPDATE', 'request-id': 'req-fca9b254-58fe-4b54-82f4-cf81385e58be', 'type': 'job_template', 'uuid': '0c145fed-1bb4-4f52-a098-80eeb3bc0354'} 03/20/2025 01:53:45.576 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_ops_info_template'], 'oper': 'UPDATE', 'request-id': 'req-f3443a04-21c6-4b93-8270-414f0de7b147', 'type': 'job_template', 'uuid': '69b944a2-39f7-402e-b2f7-4433d113ae35'} 03/20/2025 01:53:45.656 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'check_multicast_template'], 'oper': 'UPDATE', 'request-id': 'req-e6e2daa4-a14a-42dc-83e9-ed50465ffaea', 'type': 'job_template', 'uuid': '06640ddb-2649-4269-8da5-3bdf8f72f70b'} 03/20/2025 01:53:45.680 7fabc1d366d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 557e1cc0-db77-4fad-9d2b-bd5b02046646 object_type = job_template identifier_name = default-global-system-config:existing_fabric_onboard_template url = http://10.0.0.42:8082/job-template/557e1cc0-db77-4fad-9d2b-bd5b02046646 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"job-template": {"uuid": "557e1cc0-db77-4fad-9d2b-bd5b02046646", "fq_name": ["default-global-system-config", "existing_fabric_onboard_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/existing_fabric_onboard.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_device.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 20, "sequence_no": 1}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_role.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 2}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 5, "sequence_no": 3}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/device_import.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 40, "sequence_no": 4}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/topology_discovery.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 5}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\", \"management_subnets\", \"device_auth\", \"node_profiles\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"fabric_display_name\": {\"type\": \"string\"}, \"fabric_cluster_id\": {\"type\": \"integer\"}, \"management_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"description\": \"List of the management network subnets for the fabric\", \"additionalProperties\": false, \"required\": [\"cidr\"], \"properties\": {\"cidr\": {\"type\": \"string\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}, \"gateway\": {\"type\": \"string\", \"format\": \"ipv4\"}}}}, \"loopback_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that fabric device loopback ips can be allocated.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"overlay_loopback_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that fabric device overlay loopback ips can be allocated.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"fabric_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that could be carved out for the p2p networks between fabric devices.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"pnf_servicechain_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that could be carved out for service chaining between fabric devices.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"fabric_asn_pool\": {\"type\": \"array\", \"items\": {\"title\": \"eBGP ASN Pool for fabric underlay network\", \"type\": \"object\", \"description\": \"List of the ASN pools that could be used to configure the eBGP peers for the IP fabric\", \"properties\": {\"asn_min\": {\"type\": \"integer\"}, \"asn_max\": {\"type\": \"integer\"}}, \"required\": [\"asn_min\", \"asn_max\"]}}, \"overlay_ibgp_asn\": {\"type\": \"integer\", \"title\": \"iBGP ASN for Contrail overlay network\", \"default\": 64512}, \"device_auth\": {\"title\": \"Device Auth\", \"type\": \"array\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"required\": [\"username\", \"password\"], \"properties\": {\"username\": {\"type\": \"string\"}, \"password\": {\"type\": \"string\"}}}}, \"node_profiles\": {\"type\": \"array\", \"items\": {\"title\": \"Node profile\", \"type\": \"object\", \"description\": \"List of node profiles to be used by the fabric.\", \"additionalProperties\": false, \"properties\": {\"node_profile_name\": {\"type\": \"string\"}, \"serial_nums\": {\"type\": \"array\", \"description\": \"Optional list of serial numbers of fabric devices that we want to associate with this node profile.\", \"items\": {\"type\": \"string\"}}}, \"required\": [\"node_profile_name\"]}}, \"interface_filters\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"]}, \"expr\": {\"type\": \"string\"}}, \"title\": \"filter object\", \"description\": \"filter object having op and expr fields\", \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}, \"manage_underlay\": {\"title\": \"Manage underlay networking\", \"type\": \"boolean\", \"description\": \"Set to true if need to configure underlay networking\", \"default\": false}, \"import_configured\": {\"type\": \"boolean\", \"default\": false, \"description\": \"Not importing configured interfaces by default. Set this option to true if configured interfaces need to be imported as part of onboarding.\"}, \"device_count\": {\"title\": \"Number of fabric devices\", \"type\": \"integer\", \"description\": \"Total number of devices in the fabric that needs to be zero-touch provisioned\"}, \"enterprise_style\": {\"type\": \"boolean\", \"default\": true, \"description\": \"True if enterprise style, false if sp-style configuration\"}, \"disable_vlan_vn_uniqueness_check\": {\"type\": \"boolean\", \"default\": false, \"description\": \"True if vlan-vn uniqueness validation checks needs to be disabled, false if enable all complex validations\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Existing Fabric Onboarding"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:45.813 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'existing_fabric_onboard_template'], 'oper': 'UPDATE', 'request-id': 'req-61b0467c-569c-4d6c-a234-c89a7ad68894', 'type': 'job_template', 'uuid': '557e1cc0-db77-4fad-9d2b-bd5b02046646'} 03/20/2025 01:53:45.873 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'vcenter_import_template'], 'oper': 'UPDATE', 'request-id': 'req-d263ab8f-4ab0-4976-a9b9-7b3b738883fe', 'type': 'job_template', 'uuid': '7c65339d-5890-4645-b098-0fcb9b502849'} 03/20/2025 01:53:46.020 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'discover_server_template'], 'oper': 'UPDATE', 'request-id': 'req-dfd3523e-8890-4a49-b1cb-90be6e19ba5c', 'type': 'job_template', 'uuid': 'c3138010-0394-4701-a7a3-1554e46dc2a1'} 03/20/2025 01:53:46.048 7fabb07076d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b691919f-cac7-4325-8df4-ca91b7671a33 object_type = job_template identifier_name = default-global-system-config:server_import_template url = http://10.0.0.42:8082/job-template/b691919f-cac7-4325-8df4-ca91b7671a33 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"job-template": {"uuid": "b691919f-cac7-4325-8df4-ca91b7671a33", "fq_name": ["default-global-system-config", "server_import_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/server_import.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"server import\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"encoded_file\": {\"$id\": \"/properties/encoded_file\", \"description\": \"The Encoded File to Import\", \"type\": \"string\"}, \"file_format\": {\"$id\": \"/properties/file_format\", \"type\": \"string\", \"description\": \"The format of the encoded input file\", \"enum\": [\"yaml\", \"json\", \"YAML\", \"JSON\"]}, \"cc_username\": {\"$id\": \"/properties/cc_username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/cc_password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"contrail_command_host\": {\"$id\": \"/properties/contrail_command_host\", \"description\": \"The Contrail Command IP\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Server Import"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:46.101 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'server_import_template'], 'oper': 'UPDATE', 'request-id': 'req-402f05ff-4fa1-46de-a743-fb2e61998b29', 'type': 'job_template', 'uuid': 'b691919f-cac7-4325-8df4-ca91b7671a33'} 03/20/2025 01:53:46.144 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'node_profile_template'], 'oper': 'UPDATE', 'request-id': 'req-a7950f12-c6cd-4c8e-88b2-364b8eb9d4e6', 'type': 'job_template', 'uuid': '2d3b754b-1cec-4234-81a2-2aa0a7d0d124'} 03/20/2025 01:53:46.209 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_mac_mob_template'], 'oper': 'UPDATE', 'request-id': 'req-a916b226-53ab-4af8-8fa4-ec0dabae0fe6', 'type': 'job_template', 'uuid': '60674ba0-4a09-45fb-b1e0-c2766559fcb0'} 03/20/2025 01:53:46.236 7fabb06d02e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 93eab50d-2322-4f8d-9241-a7e649235542 object_type = job_template identifier_name = default-global-system-config:rma_activate_template url = http://10.0.0.42:8082/job-template/93eab50d-2322-4f8d-9241-a7e649235542 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"job-template": {"uuid": "93eab50d-2322-4f8d-9241-a7e649235542", "fq_name": ["default-global-system-config", "rma_activate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/rma_activate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 1}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 2}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 20, "sequence_no": 3}]}, "job_template_recovery_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": null, "device_family": null, "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"RMA activate\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"rma_devices\": {\"type\": \"array\", \"items\": {\"title\": \"RMA Devices\", \"type\": \"object\", \"description\": \"List of devices and corresponding serial numbers to RMA\", \"additionalProperties\": false, \"properties\": {\"device_uuid\": {\"type\": \"string\", \"format\": \"uuid\"}, \"serial_number\": {\"type\": \"string\"}}, \"required\": [\"device_uuid\", \"serial_number\"]}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "RMA Activation"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:46.295 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rma_activate_template'], 'oper': 'UPDATE', 'request-id': 'req-bc2893ed-4cdb-4942-8842-3b8ce12a84eb', 'type': 'job_template', 'uuid': '93eab50d-2322-4f8d-9241-a7e649235542'} 03/20/2025 01:53:46.416 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_chassis_info_template'], 'oper': 'UPDATE', 'request-id': 'req-e08c4917-d954-4aa7-bd18-566f7a77e632', 'type': 'job_template', 'uuid': '24135c37-f886-4dde-a78d-e508dcf0ee8c'} 03/20/2025 01:53:46.485 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'hardware_inventory_template'], 'oper': 'UPDATE', 'request-id': 'req-7616dbc5-39bd-4982-84c0-28887b1d3c08', 'type': 'job_template', 'uuid': '3b3990e6-20e8-40f4-84b4-e4f216493970'} 03/20/2025 01:53:46.634 7fabc1ce9390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 854711b9-c61c-4545-a864-adf9558852f8 object_type = config_properties identifier_name = default-global-system-config:config_property url = http://10.0.0.42:8082/config-properties/854711b9-c61c-4545-a864-adf9558852f8 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"config-properties": {"uuid": "854711b9-c61c-4545-a864-adf9558852f8", "fq_name": ["default-global-system-config", "config_property"], "parent_type": "global-system-config", "properties": {"key_value_pair": [{"key": "junos_commit_timeout", "value": "600"}, {"key": "total_retry_timeout", "value": "600"}, {"key": "device_command_timeout", "value": "600"}, {"key": "ztp_timeout", "value": "570"}]}, "display_name": "Config Property"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:46.662 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'config_property'], 'oper': 'UPDATE', 'request-id': 'req-3011c0cc-d7f7-4e87-af02-ef7f09607b24', 'type': 'config_properties', 'uuid': '854711b9-c61c-4545-a864-adf9558852f8'} 03/20/2025 01:53:46.708 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-f10e443c-61e1-4d8d-8c3e-487d6ecf2897', 'type': 'access_control_list', 'uuid': 'df83a9c3-866e-4ef4-8457-9d8f1ab72fe8'} 03/20/2025 01:53:46.877 7fabc01c8e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/global-system-config/92e769a6-5754-45f5-bd68-145125efbf0e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"global-system-config": {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "fq_name": ["default-global-system-config"], "supported_device_families": {"device_family": ["junos", "junos-qfx"]}, "supported_vendor_hardwares": {"vendor_hardware": ["juniper-qfx10002-72q", "juniper-qfx10002-36q", "juniper-qfx10002-60c", "juniper-qfx10016", "juniper-qfx10008", "juniper-vqfx-10000", "juniper-qfx5100-48sh-afi", "juniper-qfx5100-48sh-afo", "juniper-qfx5100-48th-afi", "juniper-qfx5100-48th-afo", "juniper-qfx5100-48s-6q", "juniper-qfx5100-96s-8q", "juniper-qfx5100-48t", "juniper-qfx5100-48t-6q", "juniper-qfx5100-24q-2p", "juniper-qfx5100-24q-aa", "juniper-qfx5100e-48s-6q", "juniper-qfx5100e-96s-8q", "juniper-qfx5100e-48t-6q", "juniper-qfx5100e-24q-2p", "juniper-qfx5110-48s-4c", "juniper-qfx5110-32q", "juniper-qfx5120-48y-8c", "juniper-qfx5120-48t-6c", "juniper-qfx5120-32c", "juniper-qfx5220-32cd", "juniper-qfx5220-128c", "juniper-qfx5200-32c-32q", "juniper-qfx5200-48y", "juniper-qfx5210-64c", "juniper-vmx", "juniper-mx80", "juniper-mx80-48t", "juniper-mx204", "juniper-mx240", "juniper-mx480", "juniper-mx960", "juniper-mx2008", "juniper-mx2010", "juniper-mx2020", "juniper-mx10003", "juniper-jnp10008", "juniper-jnp10016", "juniper-srx5400", "juniper-srx5600", "juniper-srx4600", "juniper-srx4100", "juniper-srx1500", "juniper-srx240h-poe", "juniper-vsrx", "juniper-srx5800", "juniper-srx4200"]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:46.921 7fabb37e3e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.47 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["10.0.0.42"]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:46.949 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-e7146627-7baf-4ff0-ab32-bba2eb019444', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 01:53:47.000 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-555534fd-cd10-4ecf-a9c8-1e0d86ddb11c', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:53:47.030 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48sh-afi'], 'oper': 'UPDATE', 'request-id': 'req-1824a4ec-2cc4-44e8-b40e-1938361358a7', 'type': 'hardware', 'uuid': 'af195950-079e-4902-98e2-6527fc862d94'} 03/20/2025 01:53:47.077 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48sh-afo'], 'oper': 'UPDATE', 'request-id': 'req-a920415f-05c2-471a-8f42-655e1db74429', 'type': 'hardware', 'uuid': 'a9df6e2f-ec33-44b4-9820-cae2d48330d0'} 03/20/2025 01:53:47.095 7fabb06e6a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8728829f-2197-4a71-af55-daa7e12b1ed0 object_type = hardware identifier_name = juniper-qfx5100-48th-afi url = http://10.0.0.42:8082/hardware/8728829f-2197-4a71-af55-daa7e12b1ed0 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "8728829f-2197-4a71-af55-daa7e12b1ed0", "fq_name": ["juniper-qfx5100-48th-afi"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:47.130 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48th-afi'], 'oper': 'UPDATE', 'request-id': 'req-92ef48d1-0ef4-47fb-8dc9-bf5774dc3a36', 'type': 'hardware', 'uuid': '8728829f-2197-4a71-af55-daa7e12b1ed0'} 03/20/2025 01:53:47.177 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48th-afo'], 'oper': 'UPDATE', 'request-id': 'req-a3e6d0dd-f374-4451-b8d7-c26abaddd37c', 'type': 'hardware', 'uuid': '64ee2add-3c72-41cb-9629-07740b1e4fbf'} 03/20/2025 01:53:47.276 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48s-6q'], 'oper': 'UPDATE', 'request-id': 'req-9c2d69c9-3de3-4497-9a62-51e26908c4f0', 'type': 'hardware', 'uuid': 'fcb12878-be75-4af6-b628-658a82be2c05'} 03/20/2025 01:53:47.300 7fabb144d048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b5fda0b8-96b6-47a2-be59-c923311f6222 object_type = hardware identifier_name = juniper-qfx5100-96s-8q url = http://10.0.0.42:8082/hardware/b5fda0b8-96b6-47a2-be59-c923311f6222 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "b5fda0b8-96b6-47a2-be59-c923311f6222", "fq_name": ["juniper-qfx5100-96s-8q"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:47.326 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-96s-8q'], 'oper': 'UPDATE', 'request-id': 'req-4860f717-0edc-4cc4-924a-9092f48a75f4', 'type': 'hardware', 'uuid': 'b5fda0b8-96b6-47a2-be59-c923311f6222'} 03/20/2025 01:53:47.399 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48t'], 'oper': 'UPDATE', 'request-id': 'req-d7ba980f-2e60-4ccf-9cc1-8c024aaa5988', 'type': 'hardware', 'uuid': 'aa6f29a0-5722-40d5-973e-bbb5cd4e89d8'} 03/20/2025 01:53:47.509 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48t-6q'], 'oper': 'UPDATE', 'request-id': 'req-91ab414e-d762-4ffc-b041-b0fc0743d46a', 'type': 'hardware', 'uuid': '1d2d462d-0fb2-4789-ad74-a17b69549fbe'} 03/20/2025 01:53:47.564 7fabb37e9cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e37b1144-2678-44f5-ac06-565c85dba363 object_type = hardware identifier_name = juniper-qfx5100-24q-2p url = http://10.0.0.42:8082/hardware/e37b1144-2678-44f5-ac06-565c85dba363 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "e37b1144-2678-44f5-ac06-565c85dba363", "fq_name": ["juniper-qfx5100-24q-2p"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:47.646 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-24q-2p'], 'oper': 'UPDATE', 'request-id': 'req-fbc841c9-b9cd-4db4-a83c-7188babe649f', 'type': 'hardware', 'uuid': 'e37b1144-2678-44f5-ac06-565c85dba363'} 03/20/2025 01:53:47.692 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-24q-aa'], 'oper': 'UPDATE', 'request-id': 'req-4f28afcd-d9f1-43bd-87b0-0f5874c310c5', 'type': 'hardware', 'uuid': 'b8e9304b-5ff1-49fa-a46e-5e4eec0575d7'} 03/20/2025 01:53:47.748 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-48s-6q'], 'oper': 'UPDATE', 'request-id': 'req-8dd76cf4-afe1-48c5-910e-792a26ed28fd', 'type': 'hardware', 'uuid': '3192d0f9-2cf6-4140-81bb-bffe860ed3a7'} 03/20/2025 01:53:47.772 7fabc1d3bd68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fbca2bde-1157-4c32-8d85-94628655a50d object_type = hardware identifier_name = juniper-qfx5100e-96s-8q url = http://10.0.0.42:8082/hardware/fbca2bde-1157-4c32-8d85-94628655a50d operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "fbca2bde-1157-4c32-8d85-94628655a50d", "fq_name": ["juniper-qfx5100e-96s-8q"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:47.790 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-96s-8q'], 'oper': 'UPDATE', 'request-id': 'req-ccaed335-e1b5-4715-93ae-0d21a1dc71af', 'type': 'hardware', 'uuid': 'fbca2bde-1157-4c32-8d85-94628655a50d'} 03/20/2025 01:53:47.850 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-48t-6q'], 'oper': 'UPDATE', 'request-id': 'req-9457d488-9d7c-43ac-acfe-ef21613fa82d', 'type': 'hardware', 'uuid': '66d4fb5c-8901-49cd-8d5f-33d2f144be7a'} 03/20/2025 01:53:47.901 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-24q-2p'], 'oper': 'UPDATE', 'request-id': 'req-9f6ff735-e4be-4480-8f9d-f8706e36b55b', 'type': 'hardware', 'uuid': 'd764f786-f2fe-4657-bc22-7632490bffe1'} 03/20/2025 01:53:47.917 7fabb37d4ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fa1a34c7-5f27-4549-8796-aadaea4de410 object_type = hardware identifier_name = juniper-qfx5110-48s-4c url = http://10.0.0.42:8082/hardware/fa1a34c7-5f27-4549-8796-aadaea4de410 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "fa1a34c7-5f27-4549-8796-aadaea4de410", "fq_name": ["juniper-qfx5110-48s-4c"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:47.936 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5110-48s-4c'], 'oper': 'UPDATE', 'request-id': 'req-8bc19fe3-58f4-4c19-af82-9251dfd4c103', 'type': 'hardware', 'uuid': 'fa1a34c7-5f27-4549-8796-aadaea4de410'} 03/20/2025 01:53:48.028 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5110-32q'], 'oper': 'UPDATE', 'request-id': 'req-dbec45a0-eb29-47ac-95f6-e6f04f335ab0', 'type': 'hardware', 'uuid': 'c3fec083-dd82-4083-b3f2-453812057208'} 03/20/2025 01:53:48.082 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-48y-8c'], 'oper': 'UPDATE', 'request-id': 'req-5cc24606-482a-4e4f-a09e-de03eb4119a4', 'type': 'hardware', 'uuid': '27ecd611-514e-4d80-a2d4-3021696d7eb9'} 03/20/2025 01:53:48.104 7fabb06ddf60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1742fce4-8197-411d-a693-a0540bbe40ab object_type = hardware identifier_name = juniper-qfx5120-32c url = http://10.0.0.42:8082/hardware/1742fce4-8197-411d-a693-a0540bbe40ab operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "1742fce4-8197-411d-a693-a0540bbe40ab", "fq_name": ["juniper-qfx5120-32c"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:48.120 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-32c'], 'oper': 'UPDATE', 'request-id': 'req-de0ff130-d6fc-4c74-b2ba-5c75ef9c3aa4', 'type': 'hardware', 'uuid': '1742fce4-8197-411d-a693-a0540bbe40ab'} 03/20/2025 01:53:48.174 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-48t-6c'], 'oper': 'UPDATE', 'request-id': 'req-2c3da389-791a-429d-b10e-c0b6f405221f', 'type': 'hardware', 'uuid': 'd279f6fc-b9c8-4f4d-8d73-da112b1c5da1'} 03/20/2025 01:53:48.257 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5220-32cd'], 'oper': 'UPDATE', 'request-id': 'req-8d59352e-b899-4daf-bef6-81e30eee579d', 'type': 'hardware', 'uuid': '1c5db8fa-469d-4860-acb2-4ef132de2663'} 03/20/2025 01:53:48.283 7fabc1d3bd68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37463e7e-9d10-4804-b22b-14d30a1efe3f object_type = hardware identifier_name = juniper-qfx5220-128c url = http://10.0.0.42:8082/hardware/37463e7e-9d10-4804-b22b-14d30a1efe3f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "37463e7e-9d10-4804-b22b-14d30a1efe3f", "fq_name": ["juniper-qfx5220-128c"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:48.308 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5220-128c'], 'oper': 'UPDATE', 'request-id': 'req-664ed98b-75bb-41ce-b749-333f69a77006', 'type': 'hardware', 'uuid': '37463e7e-9d10-4804-b22b-14d30a1efe3f'} 03/20/2025 01:53:48.328 7fabb37da438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3688031d-5203-42b0-ac58-7dcd46cf5ea1 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.42:8082/alarm/3688031d-5203-42b0-ac58-7dcd46cf5ea1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "3688031d-5203-42b0-ac58-7dcd46cf5ea1", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:48.342 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5200-32c-32q'], 'oper': 'UPDATE', 'request-id': 'req-9606af34-cb35-43a2-acb5-f408480ddeeb', 'type': 'hardware', 'uuid': 'b58382bd-da81-487b-ac73-e48a93b6b9b1'} 03/20/2025 01:53:48.367 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-d35bad1e-20e8-48c7-9087-0a847738e51b', 'type': 'alarm', 'uuid': '3688031d-5203-42b0-ac58-7dcd46cf5ea1'} 03/20/2025 01:53:48.387 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5200-48y'], 'oper': 'UPDATE', 'request-id': 'req-10e8d804-00fd-444d-993d-c716431d7e93', 'type': 'hardware', 'uuid': 'd9afe4fa-f539-47d6-a1b7-c9f0173c023e'} 03/20/2025 01:53:48.443 7fabb07068d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f84879fb-9269-4886-abeb-2c4b6fb23853 object_type = hardware identifier_name = juniper-qfx5210-64c url = http://10.0.0.42:8082/hardware/f84879fb-9269-4886-abeb-2c4b6fb23853 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "f84879fb-9269-4886-abeb-2c4b6fb23853", "fq_name": ["juniper-qfx5210-64c"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:48.465 7fabc1cadac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.12 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["10.0.0.42"]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:48.475 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5210-64c'], 'oper': 'UPDATE', 'request-id': 'req-1d886016-d3db-4a84-915e-8d4dea298ee7', 'type': 'hardware', 'uuid': 'f84879fb-9269-4886-abeb-2c4b6fb23853'} 03/20/2025 01:53:48.491 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-5c6ae361-7654-4817-a8dc-fac5ea3985f6', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:53:48.534 7fabc1cff240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 56f4320b-26d1-451b-9fe7-f4ff57616681 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.42:8082/alarm/56f4320b-26d1-451b-9fe7-f4ff57616681 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "56f4320b-26d1-451b-9fe7-f4ff57616681", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:48.554 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-72q'], 'oper': 'UPDATE', 'request-id': 'req-cc41b9e6-4fb0-4e4d-8195-c93712360cab', 'type': 'hardware', 'uuid': '72219265-ef00-41f3-aec1-7902e209cec0'} 03/20/2025 01:53:48.566 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-f8df844f-2372-418d-80c8-3a3d624ad08c', 'type': 'alarm', 'uuid': '56f4320b-26d1-451b-9fe7-f4ff57616681'} 03/20/2025 01:53:48.649 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-36q'], 'oper': 'UPDATE', 'request-id': 'req-092b7427-1a8f-4181-9b2a-ba01e03ea596', 'type': 'hardware', 'uuid': '7d4d0c09-3cab-4c5a-910d-513627d87940'} 03/20/2025 01:53:48.675 7fabc1cc7e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5adb57cf-4039-453d-95b2-5bd4d082bf12 object_type = hardware identifier_name = juniper-qfx10002-60c url = http://10.0.0.42:8082/hardware/5adb57cf-4039-453d-95b2-5bd4d082bf12 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "5adb57cf-4039-453d-95b2-5bd4d082bf12", "fq_name": ["juniper-qfx10002-60c"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:48.700 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-60c'], 'oper': 'UPDATE', 'request-id': 'req-dcd9cb9f-35af-49c0-aa65-540700e85365', 'type': 'hardware', 'uuid': '5adb57cf-4039-453d-95b2-5bd4d082bf12'} 03/20/2025 01:53:48.721 7fabb06db438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fafc8875-3dfc-4334-895a-c8c457986dde object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.42:8082/alarm/fafc8875-3dfc-4334-895a-c8c457986dde operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "fafc8875-3dfc-4334-895a-c8c457986dde", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:48.737 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10016'], 'oper': 'UPDATE', 'request-id': 'req-317b8345-733e-40d6-9684-5c7771daa933', 'type': 'hardware', 'uuid': 'fb7680b6-1f0f-466c-a7f3-8ad8f1e9aabc'} 03/20/2025 01:53:48.750 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-95ffc217-85db-47b7-8dcb-e6dc9ae74deb', 'type': 'alarm', 'uuid': 'fafc8875-3dfc-4334-895a-c8c457986dde'} 03/20/2025 01:53:48.772 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10008'], 'oper': 'UPDATE', 'request-id': 'req-dda73401-b7fe-4fd1-8d75-7ef8baaaaa71', 'type': 'hardware', 'uuid': '93247cc2-4f3a-474e-b057-eaaca5558e5b'} 03/20/2025 01:53:48.843 7fabb23ea198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 686e7a79-28fa-4025-a978-32d303f4c64e object_type = hardware identifier_name = juniper-vqfx-10000 url = http://10.0.0.42:8082/hardware/686e7a79-28fa-4025-a978-32d303f4c64e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "686e7a79-28fa-4025-a978-32d303f4c64e", "fq_name": ["juniper-vqfx-10000"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:48.860 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vqfx-10000'], 'oper': 'UPDATE', 'request-id': 'req-2134e1c0-d090-4c85-929c-89c057624786', 'type': 'hardware', 'uuid': '686e7a79-28fa-4025-a978-32d303f4c64e'} 03/20/2025 01:53:48.889 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx80'], 'oper': 'UPDATE', 'request-id': 'req-8e8ab20d-7bba-4999-b0d6-7f266e148379', 'type': 'hardware', 'uuid': 'a0c59ea3-4f54-4802-a16e-0f0fe5a9f6c4'} 03/20/2025 01:53:49.215 7fabb0feeac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e0a70522-a423-418b-ab13-133cdcba20fa object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.42:8082/alarm/e0a70522-a423-418b-ab13-133cdcba20fa operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "e0a70522-a423-418b-ab13-133cdcba20fa", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:49.263 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx80-48t'], 'oper': 'UPDATE', 'request-id': 'req-b9e452e9-bd21-46ee-8cc7-60630549983c', 'type': 'hardware', 'uuid': '83129f9f-bd77-4851-a0fb-5540fb15e1cd'} 03/20/2025 01:53:49.269 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-68d86747-cb6e-490e-9cfa-1b34285c19ee', 'type': 'alarm', 'uuid': 'e0a70522-a423-418b-ab13-133cdcba20fa'} 03/20/2025 01:53:49.292 7fabb13f1b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7bf74f8d-2893-41fd-9a47-80f5ea746601 object_type = hardware identifier_name = juniper-mx204 url = http://10.0.0.42:8082/hardware/7bf74f8d-2893-41fd-9a47-80f5ea746601 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "7bf74f8d-2893-41fd-9a47-80f5ea746601", "fq_name": ["juniper-mx204"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:49.330 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx204'], 'oper': 'UPDATE', 'request-id': 'req-5da46835-962a-4f2c-b04f-78cdc3cfb466', 'type': 'hardware', 'uuid': '7bf74f8d-2893-41fd-9a47-80f5ea746601'} 03/20/2025 01:53:49.374 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx240'], 'oper': 'UPDATE', 'request-id': 'req-bf5f4841-9138-4a6d-8a85-e4a716450d24', 'type': 'hardware', 'uuid': '2f2eed46-0ff0-4f6f-8678-0161a518e93c'} 03/20/2025 01:53:49.430 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx480'], 'oper': 'UPDATE', 'request-id': 'req-88c44e06-0bfa-48a6-901d-963878bd178f', 'type': 'hardware', 'uuid': '169a8454-d9a0-4bff-8cea-b5bb8fefd416'} 03/20/2025 01:53:49.446 7fabb06c8048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.42:8082/alarm/b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:49.456 7fabc1cb48d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f138b373-e53c-4a88-a147-efce32f15910 object_type = hardware identifier_name = juniper-mx960 url = http://10.0.0.42:8082/hardware/f138b373-e53c-4a88-a147-efce32f15910 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "f138b373-e53c-4a88-a147-efce32f15910", "fq_name": ["juniper-mx960"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:49.484 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx960'], 'oper': 'UPDATE', 'request-id': 'req-201614ff-1c06-4753-bd92-27f45c362b56', 'type': 'hardware', 'uuid': 'f138b373-e53c-4a88-a147-efce32f15910'} 03/20/2025 01:53:49.503 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-5627ae02-3dab-4592-b26d-1501e8754d18', 'type': 'alarm', 'uuid': 'b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d'} 03/20/2025 01:53:49.526 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2008'], 'oper': 'UPDATE', 'request-id': 'req-11adb777-df5e-4b18-a1bf-8747406919a4', 'type': 'hardware', 'uuid': '1202c502-4699-4fa5-9319-4ee96ccbb260'} 03/20/2025 01:53:49.570 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2010'], 'oper': 'UPDATE', 'request-id': 'req-4ae3aa7a-f5d7-49a2-bffc-6fe16d679215', 'type': 'hardware', 'uuid': 'e1ffcf2f-19d6-41b9-bebb-363e1ac07adf'} 03/20/2025 01:53:49.593 7fabb0fd8ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7eb3c5e4-3940-43bf-87f8-fc438bb7b729 object_type = hardware identifier_name = juniper-mx2020 url = http://10.0.0.42:8082/hardware/7eb3c5e4-3940-43bf-87f8-fc438bb7b729 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "7eb3c5e4-3940-43bf-87f8-fc438bb7b729", "fq_name": ["juniper-mx2020"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:49.626 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2020'], 'oper': 'UPDATE', 'request-id': 'req-2829b8fb-a8b5-4849-a22f-9b101a9d63f8', 'type': 'hardware', 'uuid': '7eb3c5e4-3940-43bf-87f8-fc438bb7b729'} 03/20/2025 01:53:49.658 7fabb1a968d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8f2b5ec4-29e4-4bfe-afdf-830264fdfbae object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.42:8082/alarm/8f2b5ec4-29e4-4bfe-afdf-830264fdfbae operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "8f2b5ec4-29e4-4bfe-afdf-830264fdfbae", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:49.671 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx10003'], 'oper': 'UPDATE', 'request-id': 'req-fa62f82f-cb40-457b-81bc-fea4080140cb', 'type': 'hardware', 'uuid': '4d199e21-ac62-4ac2-bb00-cf274d12b104'} 03/20/2025 01:53:49.721 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-f694b27a-09af-4b55-987f-be8549c9b14a', 'type': 'alarm', 'uuid': '8f2b5ec4-29e4-4bfe-afdf-830264fdfbae'} 03/20/2025 01:53:49.745 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-jnp10008'], 'oper': 'UPDATE', 'request-id': 'req-20d2b135-0993-43a1-93c6-986523d95141', 'type': 'hardware', 'uuid': 'fe12d78a-6d33-42fb-8c0f-1dbc2afa9b7f'} 03/20/2025 01:53:49.793 7fabb0fd8048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0c4138fd-cac7-4d0f-8459-7e1c76592595 object_type = hardware identifier_name = juniper-jnp10016 url = http://10.0.0.42:8082/hardware/0c4138fd-cac7-4d0f-8459-7e1c76592595 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "0c4138fd-cac7-4d0f-8459-7e1c76592595", "fq_name": ["juniper-jnp10016"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:49.820 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-jnp10016'], 'oper': 'UPDATE', 'request-id': 'req-c1fb51d8-fe4a-4c72-b553-bab52b5809dc', 'type': 'hardware', 'uuid': '0c4138fd-cac7-4d0f-8459-7e1c76592595'} 03/20/2025 01:53:49.866 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vmx'], 'oper': 'UPDATE', 'request-id': 'req-f6ec679c-3c6c-444e-82db-b230f79bf2f0', 'type': 'hardware', 'uuid': '82e414ba-e1ce-404d-b2aa-a714f67c8bbd'} 03/20/2025 01:53:49.875 7fabb10a3c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.42:8082/alarm/ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:49.912 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-b05c72f2-6816-4d6f-a0b3-18b2dd392d19', 'type': 'alarm', 'uuid': 'ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc'} 03/20/2025 01:53:49.934 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5400'], 'oper': 'UPDATE', 'request-id': 'req-62d2e5eb-a130-42fb-a42c-ca4cdf1238f8', 'type': 'hardware', 'uuid': '1a84671d-00eb-4c7e-b6f6-f9e667965252'} 03/20/2025 01:53:49.950 7fabb1322f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f20e28ef-f538-4055-9a01-36ae40836464 object_type = hardware identifier_name = juniper-srx5600 url = http://10.0.0.42:8082/hardware/f20e28ef-f538-4055-9a01-36ae40836464 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "f20e28ef-f538-4055-9a01-36ae40836464", "fq_name": ["juniper-srx5600"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:49.992 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5600'], 'oper': 'UPDATE', 'request-id': 'req-835b128f-e27a-4343-9b3e-085e858fb8a2', 'type': 'hardware', 'uuid': 'f20e28ef-f538-4055-9a01-36ae40836464'} 03/20/2025 01:53:50.031 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4600'], 'oper': 'UPDATE', 'request-id': 'req-bb71f372-8d6a-4b88-b426-6655bb752929', 'type': 'hardware', 'uuid': '5f9685dd-e81d-435e-9243-0a540e51fefe'} 03/20/2025 01:53:50.073 7fabb11b0f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 77e5a4aa-a58c-424e-af48-5fdc106a8324 object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.42:8082/alarm/77e5a4aa-a58c-424e-af48-5fdc106a8324 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "77e5a4aa-a58c-424e-af48-5fdc106a8324", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:50.107 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4100'], 'oper': 'UPDATE', 'request-id': 'req-e6881f0f-1883-4dc6-a483-88d24d8683fd', 'type': 'hardware', 'uuid': '71e284e2-ae77-4dba-a0d1-26e2f00f1be5'} 03/20/2025 01:53:50.117 7fabb11a76d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 898ae40a-6c7c-4330-851b-591b6f2446c5 object_type = hardware identifier_name = juniper-srx1500 url = http://10.0.0.42:8082/hardware/898ae40a-6c7c-4330-851b-591b6f2446c5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "898ae40a-6c7c-4330-851b-591b6f2446c5", "fq_name": ["juniper-srx1500"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:50.134 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-065ae724-0547-4b82-95ab-dd1a91ba0fb0', 'type': 'alarm', 'uuid': '77e5a4aa-a58c-424e-af48-5fdc106a8324'} 03/20/2025 01:53:50.154 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx1500'], 'oper': 'UPDATE', 'request-id': 'req-99790cec-6c6f-4768-ac6c-5c9c2f17e820', 'type': 'hardware', 'uuid': '898ae40a-6c7c-4330-851b-591b6f2446c5'} 03/20/2025 01:53:50.221 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx240h-poe'], 'oper': 'UPDATE', 'request-id': 'req-c704c950-f3c6-4f23-be68-6a87b9edd6d0', 'type': 'hardware', 'uuid': 'd7c580b1-4785-41ef-a1a3-9daf18811ff2'} 03/20/2025 01:53:50.289 7fabb1110c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3688031d-5203-42b0-ac58-7dcd46cf5ea1 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.42:8082/alarm/3688031d-5203-42b0-ac58-7dcd46cf5ea1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "3688031d-5203-42b0-ac58-7dcd46cf5ea1", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:50.329 7fabb1118438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 565e6907-65a2-4ad5-a8fa-385c54978fe9 object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.42:8082/alarm/565e6907-65a2-4ad5-a8fa-385c54978fe9 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "565e6907-65a2-4ad5-a8fa-385c54978fe9", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:50.335 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5800'], 'oper': 'UPDATE', 'request-id': 'req-c44234d6-9d84-4520-8882-830808b0c912', 'type': 'hardware', 'uuid': 'a1fc1c2f-7238-4724-8499-924183b9234c'} 03/20/2025 01:53:50.346 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-2aeb2ad8-df51-4b94-abfe-a47b56830ba3', 'type': 'alarm', 'uuid': '3688031d-5203-42b0-ac58-7dcd46cf5ea1'} 03/20/2025 01:53:50.352 7fabb1147198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = af0b9bed-4914-4202-8bda-6a3399c84450 object_type = hardware identifier_name = juniper-srx4200 url = http://10.0.0.42:8082/hardware/af0b9bed-4914-4202-8bda-6a3399c84450 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"hardware": {"uuid": "af0b9bed-4914-4202-8bda-6a3399c84450", "fq_name": ["juniper-srx4200"]}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:50.405 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-2fbe410d-0861-4701-be0d-3cb17a1c3ae3', 'type': 'alarm', 'uuid': '565e6907-65a2-4ad5-a8fa-385c54978fe9'} 03/20/2025 01:53:50.426 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vsrx'], 'oper': 'UPDATE', 'request-id': 'req-c1ed5215-e065-4ed9-8a3c-265a37a21691', 'type': 'hardware', 'uuid': '2422eede-293d-4dcc-ba66-dc3fd053d42a'} 03/20/2025 01:53:50.446 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4200'], 'oper': 'UPDATE', 'request-id': 'req-81f96cfa-dafc-48f5-b19d-06f91b927d8c', 'type': 'hardware', 'uuid': 'af0b9bed-4914-4202-8bda-6a3399c84450'} 03/20/2025 01:53:50.476 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'underlay-ip-clos'], 'oper': 'UPDATE', 'request-id': 'req-a0f227db-a7a4-4f2d-bddc-29e00b769c6f', 'type': 'feature', 'uuid': '40fed233-7ed4-423d-957b-e65ddf97b206'} 03/20/2025 01:53:50.494 7fabb13b8e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0fe5d92e-e6ba-4088-8e27-145252f84834 object_type = feature identifier_name = default-global-system-config:overlay-bgp url = http://10.0.0.42:8082/feature/0fe5d92e-e6ba-4088-8e27-145252f84834 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"feature": {"uuid": "0fe5d92e-e6ba-4088-8e27-145252f84834", "fq_name": ["default-global-system-config", "overlay-bgp"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:50.518 7fabb13e9cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 56f4320b-26d1-451b-9fe7-f4ff57616681 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.42:8082/alarm/56f4320b-26d1-451b-9fe7-f4ff57616681 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "56f4320b-26d1-451b-9fe7-f4ff57616681", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:50.538 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'overlay-bgp'], 'oper': 'UPDATE', 'request-id': 'req-af23e28f-c4c0-4920-ba43-3dd2b663c0c5', 'type': 'feature', 'uuid': '0fe5d92e-e6ba-4088-8e27-145252f84834'} 03/20/2025 01:53:50.567 7fabb1ba24e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 98c54fa0-fd53-43d5-b886-d865a493de69 object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.42:8082/alarm/98c54fa0-fd53-43d5-b886-d865a493de69 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "98c54fa0-fd53-43d5-b886-d865a493de69", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:50.578 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-2a02dce0-febb-4629-a5f8-41f7bc19a878', 'type': 'alarm', 'uuid': '56f4320b-26d1-451b-9fe7-f4ff57616681'} 03/20/2025 01:53:50.579 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'l2-gateway'], 'oper': 'UPDATE', 'request-id': 'req-5ea8705b-4572-47c6-b60a-4d870bef6281', 'type': 'feature', 'uuid': '420834eb-f3b0-440d-bc7a-9e97ce8b4758'} 03/20/2025 01:53:50.610 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-9e2697f7-a9fb-4aee-89b2-7df095e3a39b', 'type': 'alarm', 'uuid': '98c54fa0-fd53-43d5-b886-d865a493de69'} 03/20/2025 01:53:50.699 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'l3-gateway'], 'oper': 'UPDATE', 'request-id': 'req-4daeb80f-41a8-43cf-bee2-3f4d2cd389ce', 'type': 'feature', 'uuid': 'f1377070-38f1-44f6-ae3e-c48ddac79ba2'} 03/20/2025 01:53:50.724 7fabb1ae8390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7cfd1d6a-cfde-4f81-9f77-520d8227364c object_type = feature identifier_name = default-global-system-config:vn-interconnect url = http://10.0.0.42:8082/feature/7cfd1d6a-cfde-4f81-9f77-520d8227364c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"feature": {"uuid": "7cfd1d6a-cfde-4f81-9f77-520d8227364c", "fq_name": ["default-global-system-config", "vn-interconnect"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:50.765 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'vn-interconnect'], 'oper': 'UPDATE', 'request-id': 'req-c1cd70c1-876e-4d56-85ec-f28ff8d3d7a0', 'type': 'feature', 'uuid': '7cfd1d6a-cfde-4f81-9f77-520d8227364c'} 03/20/2025 01:53:50.790 7fabb1b996d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fafc8875-3dfc-4334-895a-c8c457986dde object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.42:8082/alarm/fafc8875-3dfc-4334-895a-c8c457986dde operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "fafc8875-3dfc-4334-895a-c8c457986dde", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:50.801 7fabb1d2cd68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6a83ce53-3291-4f62-9530-dca7b7c04997 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.42:8082/alarm/6a83ce53-3291-4f62-9530-dca7b7c04997 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "6a83ce53-3291-4f62-9530-dca7b7c04997", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:50.830 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway'], 'oper': 'UPDATE', 'request-id': 'req-386a7d10-7d46-4130-a4a2-3394dbf6cce4', 'type': 'feature', 'uuid': 'f91bbfbc-44bf-45ee-bd07-fbef2f77f94e'} 03/20/2025 01:53:50.886 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-528390b2-00cf-40a9-8d82-b5408a9a61fd', 'type': 'alarm', 'uuid': '6a83ce53-3291-4f62-9530-dca7b7c04997'} 03/20/2025 01:53:50.909 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-2508fad7-9b54-4d12-a27b-997d37ce34cc', 'type': 'alarm', 'uuid': 'fafc8875-3dfc-4334-895a-c8c457986dde'} 03/20/2025 01:53:50.911 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'assisted-replicator'], 'oper': 'UPDATE', 'request-id': 'req-e09f6dbd-5ff6-470e-af84-a4bc17e93014', 'type': 'feature', 'uuid': 'bcd62736-bbb2-4268-a804-24fa08067c08'} 03/20/2025 01:53:50.926 7fabb18ae828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4c647a97-0e6e-41fb-9220-b4fa5b91a202 object_type = feature identifier_name = default-global-system-config:port-profile url = http://10.0.0.42:8082/feature/4c647a97-0e6e-41fb-9220-b4fa5b91a202 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"feature": {"uuid": "4c647a97-0e6e-41fb-9220-b4fa5b91a202", "fq_name": ["default-global-system-config", "port-profile"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:51.067 7fabb1a46588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e0a70522-a423-418b-ab13-133cdcba20fa object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.42:8082/alarm/e0a70522-a423-418b-ab13-133cdcba20fa operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "e0a70522-a423-418b-ab13-133cdcba20fa", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:51.128 7fabb22ee0f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 16d3d6af-3722-4a3f-97d7-d7e7b36b0cac object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.42:8082/alarm/16d3d6af-3722-4a3f-97d7-d7e7b36b0cac operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "16d3d6af-3722-4a3f-97d7-d7e7b36b0cac", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:51.202 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-a9a00138-7503-4cba-adea-bc72f4999fa2', 'type': 'alarm', 'uuid': '16d3d6af-3722-4a3f-97d7-d7e7b36b0cac'} 03/20/2025 01:53:51.225 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-86bef0c9-63e8-408a-8bd4-cd099fd6c56f', 'type': 'alarm', 'uuid': 'e0a70522-a423-418b-ab13-133cdcba20fa'} 03/20/2025 01:53:51.230 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'port-profile'], 'oper': 'UPDATE', 'request-id': 'req-9f427f44-2199-4bcd-80b0-bdcbb974d122', 'type': 'feature', 'uuid': '4c647a97-0e6e-41fb-9220-b4fa5b91a202'} 03/20/2025 01:53:51.273 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'telemetry'], 'oper': 'UPDATE', 'request-id': 'req-e579027c-b362-458f-bd32-0d243d121e17', 'type': 'feature', 'uuid': 'b9253aaa-a083-4273-b203-5e6c2c1ac1f6'} 03/20/2025 01:53:51.348 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'firewall'], 'oper': 'UPDATE', 'request-id': 'req-22231fbe-660f-4b5b-a390-930cface1501', 'type': 'feature', 'uuid': '112418ab-2ad1-4403-92b9-7f47c3c0e4ea'} 03/20/2025 01:53:51.357 7fabb1673f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e02b9891-9ca3-4a17-b822-56bf3af41a51 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.42:8082/alarm/e02b9891-9ca3-4a17-b822-56bf3af41a51 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "e02b9891-9ca3-4a17-b822-56bf3af41a51", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:51.386 7fabb13b8ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.42:8082/alarm/b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:51.412 7fabb144d390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 85e55dea-678e-430c-85e3-dc44fc30a3ba object_type = feature identifier_name = default-global-system-config:infra-bms-access url = http://10.0.0.42:8082/feature/85e55dea-678e-430c-85e3-dc44fc30a3ba operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"feature": {"uuid": "85e55dea-678e-430c-85e3-dc44fc30a3ba", "fq_name": ["default-global-system-config", "infra-bms-access"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:51.527 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-54809972-16f5-484f-8ca3-489687de409b', 'type': 'alarm', 'uuid': 'e02b9891-9ca3-4a17-b822-56bf3af41a51'} 03/20/2025 01:53:51.534 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'infra-bms-access'], 'oper': 'UPDATE', 'request-id': 'req-b67469e8-9243-438f-8a66-cb4754bc5cb5', 'type': 'feature', 'uuid': '85e55dea-678e-430c-85e3-dc44fc30a3ba'} 03/20/2025 01:53:51.602 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-117a8993-017c-4319-a8a5-8cbef2a020a0', 'type': 'alarm', 'uuid': 'b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d'} 03/20/2025 01:53:51.627 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-service-chaining'], 'oper': 'UPDATE', 'request-id': 'req-0f097349-91e1-4bfe-a956-e8fdedd98f22', 'type': 'feature', 'uuid': '98ebec57-59ce-4727-b2ff-f42d908b981f'} 03/20/2025 01:53:51.684 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'leaf'], 'oper': 'UPDATE', 'request-id': 'req-45aa7be5-4154-4c0d-8584-4337fa24186d', 'type': 'physical_role', 'uuid': '523a4254-b62c-4e71-bb19-0745b7bad99a'} 03/20/2025 01:53:51.697 7fabb0feda20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b9be1540-ad7f-404b-9f70-528ee5f036a5 object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.42:8082/alarm/b9be1540-ad7f-404b-9f70-528ee5f036a5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "b9be1540-ad7f-404b-9f70-528ee5f036a5", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:51.707 7fabb120a6d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8af65424-9d4e-4f41-b947-836dfc7b3a4c object_type = physical_role identifier_name = default-global-system-config:spine url = http://10.0.0.42:8082/physical-role/8af65424-9d4e-4f41-b947-836dfc7b3a4c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"physical-role": {"uuid": "8af65424-9d4e-4f41-b947-836dfc7b3a4c", "fq_name": ["default-global-system-config", "spine"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:51.739 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'spine'], 'oper': 'UPDATE', 'request-id': 'req-47cbe90b-e590-4234-ad28-b9b2b91b58dc', 'type': 'physical_role', 'uuid': '8af65424-9d4e-4f41-b947-836dfc7b3a4c'} 03/20/2025 01:53:51.752 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-7735d7bb-839d-46ba-9828-952027ece8f3', 'type': 'alarm', 'uuid': 'b9be1540-ad7f-404b-9f70-528ee5f036a5'} 03/20/2025 01:53:51.778 7fabb0fede10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8f2b5ec4-29e4-4bfe-afdf-830264fdfbae object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.42:8082/alarm/8f2b5ec4-29e4-4bfe-afdf-830264fdfbae operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "8f2b5ec4-29e4-4bfe-afdf-830264fdfbae", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:51.847 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'superspine'], 'oper': 'UPDATE', 'request-id': 'req-7a25a2ca-0cb5-4dfa-903c-a225fabd83be', 'type': 'physical_role', 'uuid': '9468f342-b2f0-4492-9707-6683bd68520a'} 03/20/2025 01:53:51.853 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-5de84a21-4613-491e-a72b-b406576b1874', 'type': 'alarm', 'uuid': '8f2b5ec4-29e4-4bfe-afdf-830264fdfbae'} 03/20/2025 01:53:51.987 7fabb0fed8d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f599f8b8-acce-4574-8066-8db660d03fe0 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.42:8082/alarm/f599f8b8-acce-4574-8066-8db660d03fe0 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "f599f8b8-acce-4574-8066-8db660d03fe0", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:51.994 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf'], 'oper': 'UPDATE', 'request-id': 'req-5deb91a7-a72a-45d8-aa3d-3c2fdd1b8e4f', 'type': 'physical_role', 'uuid': '761deadb-c5f9-4384-8e5f-30aab996f17f'} 03/20/2025 01:53:52.060 7fabb1f49780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e9736b6f-74c6-458f-a2b2-72bc117db9bb object_type = overlay_role identifier_name = default-global-system-config:erb-ucast-gateway url = http://10.0.0.42:8082/overlay-role/e9736b6f-74c6-458f-a2b2-72bc117db9bb operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"overlay-role": {"uuid": "e9736b6f-74c6-458f-a2b2-72bc117db9bb", "fq_name": ["default-global-system-config", "erb-ucast-gateway"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:52.098 7fabb11614e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.42:8082/alarm/ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:52.109 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-ucast-gateway'], 'oper': 'UPDATE', 'request-id': 'req-7e509522-ed60-43e2-8405-5c31f1bcce0f', 'type': 'overlay_role', 'uuid': 'e9736b6f-74c6-458f-a2b2-72bc117db9bb'} 03/20/2025 01:53:52.128 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-0bb94f4e-c38c-46b5-8a69-33e780e1e8be', 'type': 'alarm', 'uuid': 'f599f8b8-acce-4574-8066-8db660d03fe0'} 03/20/2025 01:53:52.170 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-26672f70-3f6a-4c2e-b30e-7fcd23938db9', 'type': 'alarm', 'uuid': 'ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc'} 03/20/2025 01:53:52.205 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access'], 'oper': 'UPDATE', 'request-id': 'req-f9fca6e4-5a0d-4bf8-8b9b-007a19435992', 'type': 'overlay_role', 'uuid': 'c22d4b0f-be2c-48cd-aac0-249437277343'} 03/20/2025 01:53:52.269 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'oper': 'UPDATE', 'request-id': 'req-e313b3fb-62db-4890-934b-b364d3d25e66', 'type': 'overlay_role', 'uuid': '25900aa8-37cf-4f71-94cc-fa821f26527b'} 03/20/2025 01:53:52.290 7fabc002a048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e663ef65-4088-44c5-9eb2-47a9eb3f61e0 object_type = overlay_role identifier_name = default-global-system-config:crb-gateway url = http://10.0.0.42:8082/overlay-role/e663ef65-4088-44c5-9eb2-47a9eb3f61e0 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"overlay-role": {"uuid": "e663ef65-4088-44c5-9eb2-47a9eb3f61e0", "fq_name": ["default-global-system-config", "crb-gateway"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:52.295 7fabb1533048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 08b1b6c6-a070-47bd-8038-453eb2ee0fc2 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.42:8082/alarm/08b1b6c6-a070-47bd-8038-453eb2ee0fc2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "08b1b6c6-a070-47bd-8038-453eb2ee0fc2", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:52.348 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway'], 'oper': 'UPDATE', 'request-id': 'req-c836413a-2a2c-4e10-8d4b-255c8cec9f22', 'type': 'overlay_role', 'uuid': 'e663ef65-4088-44c5-9eb2-47a9eb3f61e0'} 03/20/2025 01:53:52.371 7fabb06c6198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 77e5a4aa-a58c-424e-af48-5fdc106a8324 object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.42:8082/alarm/77e5a4aa-a58c-424e-af48-5fdc106a8324 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "77e5a4aa-a58c-424e-af48-5fdc106a8324", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:52.398 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-e4b38f5d-c3f0-4771-91b2-14b5b5dd8189', 'type': 'alarm', 'uuid': '08b1b6c6-a070-47bd-8038-453eb2ee0fc2'} 03/20/2025 01:53:52.440 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-748db305-bfa2-4eef-80fc-d78e099047e4', 'type': 'overlay_role', 'uuid': 'bfdb2e08-75d8-4995-97a1-f29320f374a1'} 03/20/2025 01:53:52.470 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-458fc822-6fb3-489b-9679-088af272e41d', 'type': 'alarm', 'uuid': '77e5a4aa-a58c-424e-af48-5fdc106a8324'} 03/20/2025 01:53:52.494 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'oper': 'UPDATE', 'request-id': 'req-343d0a24-328c-4f6b-8542-c952170832f8', 'type': 'overlay_role', 'uuid': '25900aa8-37cf-4f71-94cc-fa821f26527b'} 03/20/2025 01:53:52.526 7fabc1328c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e7464c4b-993e-4687-82ea-613eab5f01b4 object_type = overlay_role identifier_name = default-global-system-config:dc-gateway url = http://10.0.0.42:8082/overlay-role/e7464c4b-993e-4687-82ea-613eab5f01b4 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"overlay-role": {"uuid": "e7464c4b-993e-4687-82ea-613eab5f01b4", "fq_name": ["default-global-system-config", "dc-gateway"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:52.567 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway'], 'oper': 'UPDATE', 'request-id': 'req-9bbb5ef4-4ce8-4004-9039-2e8926d864a1', 'type': 'overlay_role', 'uuid': 'e7464c4b-993e-4687-82ea-613eab5f01b4'} 03/20/2025 01:53:52.578 7fabb0774cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4c365283-3f6b-4ce3-98fb-4d5564da3a54 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.42:8082/alarm/4c365283-3f6b-4ce3-98fb-4d5564da3a54 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "4c365283-3f6b-4ce3-98fb-4d5564da3a54", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:52.632 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway'], 'oper': 'UPDATE', 'request-id': 'req-22fc4839-02df-4663-8f2e-c484f3c9c396', 'type': 'overlay_role', 'uuid': 'c5af2d40-46cd-463e-ad5b-340c8d720ce8'} 03/20/2025 01:53:52.647 7fabb2681ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 565e6907-65a2-4ad5-a8fa-385c54978fe9 object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.42:8082/alarm/565e6907-65a2-4ad5-a8fa-385c54978fe9 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "565e6907-65a2-4ad5-a8fa-385c54978fe9", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:52.699 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-4e907960-cf20-4732-a36c-77caa750a37d', 'type': 'alarm', 'uuid': '4c365283-3f6b-4ce3-98fb-4d5564da3a54'} 03/20/2025 01:53:52.711 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client'], 'oper': 'UPDATE', 'request-id': 'req-a4cc388d-1992-4c1e-9ddb-a8ab9c5a4180', 'type': 'overlay_role', 'uuid': '39d1feb4-f71b-4f2a-ae7b-93b1dc707367'} 03/20/2025 01:53:52.750 7fabb113f390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2af03efa-2b74-49eb-8fac-b8edafd82bfa object_type = overlay_role identifier_name = default-global-system-config:ar-replicator url = http://10.0.0.42:8082/overlay-role/2af03efa-2b74-49eb-8fac-b8edafd82bfa operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"overlay-role": {"uuid": "2af03efa-2b74-49eb-8fac-b8edafd82bfa", "fq_name": ["default-global-system-config", "ar-replicator"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:52.780 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-4f3ca845-7b01-45b0-b216-aac79810856e', 'type': 'alarm', 'uuid': '565e6907-65a2-4ad5-a8fa-385c54978fe9'} 03/20/2025 01:53:52.806 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator'], 'oper': 'UPDATE', 'request-id': 'req-7045cd33-f660-4c52-a470-cad4081c98c1', 'type': 'overlay_role', 'uuid': '2af03efa-2b74-49eb-8fac-b8edafd82bfa'} 03/20/2025 01:53:52.870 7fabb22ae048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ca5c7bd2-8580-4f61-9f45-597270fd3915 object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.42:8082/alarm/ca5c7bd2-8580-4f61-9f45-597270fd3915 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "ca5c7bd2-8580-4f61-9f45-597270fd3915", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:52.908 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'route-reflector'], 'oper': 'UPDATE', 'request-id': 'req-b0b7f5f5-0bbe-4d70-952f-2f29ccc85e7c', 'type': 'overlay_role', 'uuid': '3de07b17-fb11-4d37-aba5-a1243fbb9114'} 03/20/2025 01:53:52.941 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-99f25d64-2d83-45d9-b3c6-e8aacea58abc', 'type': 'alarm', 'uuid': 'ca5c7bd2-8580-4f61-9f45-597270fd3915'} 03/20/2025 01:53:52.959 7fabb227db70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 98c54fa0-fd53-43d5-b886-d865a493de69 object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.42:8082/alarm/98c54fa0-fd53-43d5-b886-d865a493de69 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "98c54fa0-fd53-43d5-b886-d865a493de69", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:52.960 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean'], 'oper': 'UPDATE', 'request-id': 'req-105d5c04-cd9f-4fbc-8bc8-35db2e3c8f8f', 'type': 'overlay_role', 'uuid': 'd98d9778-eee7-49d1-bedd-2dc0f86c4471'} 03/20/2025 01:53:52.999 7fabb1161cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8e4d7c54-fa65-476a-a2bd-6fcfcd955dac object_type = overlay_role identifier_name = default-global-system-config:pnf-servicechain url = http://10.0.0.42:8082/overlay-role/8e4d7c54-fa65-476a-a2bd-6fcfcd955dac operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"overlay-role": {"uuid": "8e4d7c54-fa65-476a-a2bd-6fcfcd955dac", "fq_name": ["default-global-system-config", "pnf-servicechain"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:53.032 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-286c1f3c-4f31-408c-91f7-af821e21d9ad', 'type': 'alarm', 'uuid': '98c54fa0-fd53-43d5-b886-d865a493de69'} 03/20/2025 01:53:53.094 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain'], 'oper': 'UPDATE', 'request-id': 'req-e36d2da0-1778-48f1-aa56-bd27626fa194', 'type': 'overlay_role', 'uuid': '8e4d7c54-fa65-476a-a2bd-6fcfcd955dac'} 03/20/2025 01:53:53.121 7fabb239f6d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9fc2de9a-a509-4f4c-ba90-38e77eb05d73 object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.42:8082/alarm/9fc2de9a-a509-4f4c-ba90-38e77eb05d73 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "9fc2de9a-a509-4f4c-ba90-38e77eb05d73", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:53.159 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-49bdf5fd-3b38-4e72-8c69-615d96f82cc5', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 01:53:53.194 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-ce42b02e-1ee6-42b8-ae1e-ab456ad08249', 'type': 'alarm', 'uuid': '9fc2de9a-a509-4f4c-ba90-38e77eb05d73'} 03/20/2025 01:53:53.225 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8bd701d3-5da8-4a8f-89d4-1b31bfbeb902', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 01:53:53.235 7fabb19576d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6a83ce53-3291-4f62-9530-dca7b7c04997 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.42:8082/alarm/6a83ce53-3291-4f62-9530-dca7b7c04997 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "6a83ce53-3291-4f62-9530-dca7b7c04997", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:53.257 7fabb23f9438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c566ae8-75e7-4e69-81a7-d2c2c52fd0be object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = http://10.0.0.42:8082/role-definition/8c566ae8-75e7-4e69-81a7-d2c2c52fd0be operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"role-definition": {"uuid": "8c566ae8-75e7-4e69-81a7-d2c2c52fd0be", "fq_name": ["default-global-system-config", "crb-access-spine"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:53.309 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-fa4ae4de-a24a-47dc-b567-2acbf86a1984', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 01:53:53.342 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-307d145c-516d-42df-b2ea-2c8ad34487d4', 'type': 'alarm', 'uuid': '6a83ce53-3291-4f62-9530-dca7b7c04997'} 03/20/2025 01:53:53.372 7fabb2383048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8b6abc1c-bd01-4612-85ab-0a0e23cecc68 object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.42:8082/alarm/8b6abc1c-bd01-4612-85ab-0a0e23cecc68 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "8b6abc1c-bd01-4612-85ab-0a0e23cecc68", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:53.416 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-ebf37cfb-0201-4455-b4d1-06478ad9f84f', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 01:53:53.501 7fabb263c240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 16d3d6af-3722-4a3f-97d7-d7e7b36b0cac object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.42:8082/alarm/16d3d6af-3722-4a3f-97d7-d7e7b36b0cac operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "16d3d6af-3722-4a3f-97d7-d7e7b36b0cac", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:53.508 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-09c8ba59-f7be-4b51-b927-e92d2a420be9', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 01:53:53.529 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-9fcfd656-777c-4e06-88cf-2c18a3f36808', 'type': 'alarm', 'uuid': '8b6abc1c-bd01-4612-85ab-0a0e23cecc68'} 03/20/2025 01:53:53.539 7fabb23ec630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed79f827-69d7-4efe-8849-b59ed841e4e5 object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.42:8082/role-definition/ed79f827-69d7-4efe-8849-b59ed841e4e5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"role-definition": {"uuid": "ed79f827-69d7-4efe-8849-b59ed841e4e5", "fq_name": ["default-global-system-config", "collapsed-spine"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:53.576 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-a021666a-8c2e-4d88-9ade-026cfb073930', 'type': 'alarm', 'uuid': '16d3d6af-3722-4a3f-97d7-d7e7b36b0cac'} 03/20/2025 01:53:53.594 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-ac44b03c-517f-42aa-8b43-6be2499aa12f', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 01:53:53.644 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-89ee8366-777c-49de-801c-0bed13ce8893', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 01:53:53.694 7fabb21ebac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = cc74187c-06a9-4d6b-8d8e-650afaf4a9e2 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.42:8082/alarm/cc74187c-06a9-4d6b-8d8e-650afaf4a9e2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "cc74187c-06a9-4d6b-8d8e-650afaf4a9e2", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:53.731 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-30e0db90-f536-48a4-a649-7a0fa26c9bb9', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 01:53:53.742 7fabb239fd68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e02b9891-9ca3-4a17-b822-56bf3af41a51 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.42:8082/alarm/e02b9891-9ca3-4a17-b822-56bf3af41a51 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "e02b9891-9ca3-4a17-b822-56bf3af41a51", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:53.754 7fabb263c198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e21727ee-f7c6-47ab-b972-cc324d2970e4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = http://10.0.0.42:8082/role-definition/e21727ee-f7c6-47ab-b972-cc324d2970e4 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"role-definition": {"uuid": "e21727ee-f7c6-47ab-b972-cc324d2970e4", "fq_name": ["default-global-system-config", "crb-gateway-leaf"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:53.770 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-e17f85c5-8bb2-49e0-a57e-0d87e820b5e5', 'type': 'alarm', 'uuid': 'cc74187c-06a9-4d6b-8d8e-650afaf4a9e2'} 03/20/2025 01:53:53.839 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7611cb4b-bcf0-4426-ada7-29514c4f95b0', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 01:53:53.844 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-37d75162-b69c-44d0-9d77-f208205a4ac9', 'type': 'alarm', 'uuid': 'e02b9891-9ca3-4a17-b822-56bf3af41a51'} 03/20/2025 01:53:53.896 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6c7fa9fc-1eea-43d8-a6e6-a8f023f84110', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 01:53:53.922 7fabb06d3780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2c9b02ba-35bc-4d67-86d4-0e010edd049b object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.42:8082/alarm/2c9b02ba-35bc-4d67-86d4-0e010edd049b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "2c9b02ba-35bc-4d67-86d4-0e010edd049b", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:53.955 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f49f7d92-db97-48c4-adfb-e743bb5539dc', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 01:53:53.962 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-77093873-c4e3-48b8-9b43-f726cb5bdad9', 'type': 'alarm', 'uuid': '2c9b02ba-35bc-4d67-86d4-0e010edd049b'} 03/20/2025 01:53:53.980 7fabb0fe30f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = afff3d51-5def-4b18-9404-3fefb2935eb5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = http://10.0.0.42:8082/role-definition/afff3d51-5def-4b18-9404-3fefb2935eb5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"role-definition": {"uuid": "afff3d51-5def-4b18-9404-3fefb2935eb5", "fq_name": ["default-global-system-config", "dci-gateway-leaf"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:53.996 7fabc1cb4cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b9be1540-ad7f-404b-9f70-528ee5f036a5 object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.42:8082/alarm/b9be1540-ad7f-404b-9f70-528ee5f036a5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "b9be1540-ad7f-404b-9f70-528ee5f036a5", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:54.040 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5f40d7de-935f-4507-83de-b54537513fa5', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 01:53:54.055 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-7e8725ba-baf2-4e07-8588-e893fd1822db', 'type': 'alarm', 'uuid': 'b9be1540-ad7f-404b-9f70-528ee5f036a5'} 03/20/2025 01:53:54.129 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1935f08c-74bf-4e42-ae9e-b843904806d8', 'type': 'role_definition', 'uuid': '4441e96d-2282-4154-a145-b28430c80f2c'} 03/20/2025 01:53:54.143 7fabb10822e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bcb5ab76-d8ec-4914-b025-04833530d175 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.42:8082/alarm/bcb5ab76-d8ec-4914-b025-04833530d175 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "bcb5ab76-d8ec-4914-b025-04833530d175", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:54.175 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-e7624f2e-d3de-47ec-a677-d272e9313e2e', 'type': 'role_definition', 'uuid': 'c9fce0d0-672c-43f8-a28b-6d126af91fcb'} 03/20/2025 01:53:54.188 7fabc1cb4ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9c798d45-0b2c-4ca9-91db-6944cdbcdb41 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = http://10.0.0.42:8082/role-definition/9c798d45-0b2c-4ca9-91db-6944cdbcdb41 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"role-definition": {"uuid": "9c798d45-0b2c-4ca9-91db-6944cdbcdb41", "fq_name": ["default-global-system-config", "ar-replicator-leaf"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:54.205 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-1fde26ea-3114-4eb6-ad00-50165138b051', 'type': 'alarm', 'uuid': 'bcb5ab76-d8ec-4914-b025-04833530d175'} 03/20/2025 01:53:54.228 7fabb2300390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f599f8b8-acce-4574-8066-8db660d03fe0 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.42:8082/alarm/f599f8b8-acce-4574-8066-8db660d03fe0 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "f599f8b8-acce-4574-8066-8db660d03fe0", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:54.248 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-befb7bf2-025e-46b9-bba4-55e81abb6d0d', 'type': 'role_definition', 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'} 03/20/2025 01:53:54.290 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-635d5343-049b-432f-9909-d834e02dbe89', 'type': 'alarm', 'uuid': 'f599f8b8-acce-4574-8066-8db660d03fe0'} 03/20/2025 01:53:54.307 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-8c69e1e3-749e-45a2-8b02-c4132d12a1c6', 'type': 'role_definition', 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'} 03/20/2025 01:53:54.375 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-c7b1a73b-9678-4fc6-8fad-0fd2aa233665', 'type': 'role_definition', 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'} 03/20/2025 01:53:54.393 7fabb11a7c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 35e70721-3adc-4580-ae4a-904e96a85476 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = http://10.0.0.42:8082/role-definition/35e70721-3adc-4580-ae4a-904e96a85476 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"role-definition": {"uuid": "35e70721-3adc-4580-ae4a-904e96a85476", "fq_name": ["default-global-system-config", "rr-superspine"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:54.415 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-6bc195f0-fad8-4a47-b238-860322f93d9f', 'type': 'role_definition', 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'} 03/20/2025 01:53:54.463 7fabb2012d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 08b1b6c6-a070-47bd-8038-453eb2ee0fc2 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.42:8082/alarm/08b1b6c6-a070-47bd-8038-453eb2ee0fc2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "08b1b6c6-a070-47bd-8038-453eb2ee0fc2", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:54.474 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1f2ecb20-9771-40ae-9719-0ba17dc96e2a', 'type': 'role_definition', 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'} 03/20/2025 01:53:54.530 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-0bb64843-e6eb-471c-8a5c-1d956408c0a9', 'type': 'alarm', 'uuid': '08b1b6c6-a070-47bd-8038-453eb2ee0fc2'} 03/20/2025 01:53:54.558 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-5f134f4c-5851-4fdc-9f9e-b123ef0027f7', 'type': 'role_definition', 'uuid': '5599512a-2561-4b35-9fd2-a137f3470b47'} 03/20/2025 01:53:54.593 7fabb1082240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8c6c638e-bbb4-4c25-b33e-52e56d8d42f7 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = http://10.0.0.42:8082/role-definition/8c6c638e-bbb4-4c25-b33e-52e56d8d42f7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"role-definition": {"uuid": "8c6c638e-bbb4-4c25-b33e-52e56d8d42f7", "fq_name": ["default-global-system-config", "lean-superspine"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:54.630 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-6f856917-6411-40f2-adc0-035b231b1c3b', 'type': 'role_definition', 'uuid': '8c6c638e-bbb4-4c25-b33e-52e56d8d42f7'} 03/20/2025 01:53:54.677 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-355c13cc-fc06-4202-8bda-a106aa33e99d', 'type': 'role_definition', 'uuid': '497e1087-553f-474a-a3e1-980bcbab6811'} 03/20/2025 01:53:54.701 7fabb06dd438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4c365283-3f6b-4ce3-98fb-4d5564da3a54 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.42:8082/alarm/4c365283-3f6b-4ce3-98fb-4d5564da3a54 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "4c365283-3f6b-4ce3-98fb-4d5564da3a54", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:54.744 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-a0820d3c-1fe0-4bb5-b093-842886bb5f49', 'type': 'role_definition', 'uuid': '9dd9ebf4-7da7-464c-82d2-83006561567f'} 03/20/2025 01:53:54.785 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-d4065b3c-1594-4765-a4a3-4ea90ad37bdc', 'type': 'alarm', 'uuid': '4c365283-3f6b-4ce3-98fb-4d5564da3a54'} 03/20/2025 01:53:54.812 7fabb22b0390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d18b1b93-9d78-4930-827f-c4c6e3b9d639 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = http://10.0.0.42:8082/role-definition/d18b1b93-9d78-4930-827f-c4c6e3b9d639 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"role-definition": {"uuid": "d18b1b93-9d78-4930-827f-c4c6e3b9d639", "fq_name": ["default-global-system-config", "pnf-servicechain-leaf"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:54.836 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-88d235fa-539d-438a-9b23-47b4c93a9d04', 'type': 'role_definition', 'uuid': 'd18b1b93-9d78-4930-827f-c4c6e3b9d639'} 03/20/2025 01:53:54.905 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf', 'l3-gateway'], 'oper': 'UPDATE', 'request-id': 'req-6b924c3e-80bb-4b53-b113-fe3976fe0a6e', 'type': 'feature_config', 'uuid': '234b5997-a615-48a7-8bc0-600803ea709b'} 03/20/2025 01:53:54.964 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine', 'assisted-replicator'], 'oper': 'UPDATE', 'request-id': 'req-f867c398-746f-4891-a5ea-0daab9963ff5', 'type': 'feature_config', 'uuid': '891a6f6b-74e3-4556-8aa9-e94f8bb88712'} 03/20/2025 01:53:54.982 7fabb0fed2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ca5c7bd2-8580-4f61-9f45-597270fd3915 object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.42:8082/alarm/ca5c7bd2-8580-4f61-9f45-597270fd3915 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "ca5c7bd2-8580-4f61-9f45-597270fd3915", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:54.986 7fabb18ae828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1f9fbe3e-387a-4755-b94c-85618ea9f2dc object_type = feature_config identifier_name = default-global-system-config:ar-client-leaf:assisted-replicator url = http://10.0.0.42:8082/feature-config/1f9fbe3e-387a-4755-b94c-85618ea9f2dc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"feature-config": {"uuid": "1f9fbe3e-387a-4755-b94c-85618ea9f2dc", "fq_name": ["default-global-system-config", "ar-client-leaf", "assisted-replicator"], "parent_type": "role-definition", "feature_config_additional_params": {"key_value_pair": [{"key": "replicator_activation_delay", "value": "30"}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:55.070 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf', 'assisted-replicator'], 'oper': 'UPDATE', 'request-id': 'req-97d9ff95-6168-496c-9ba6-130cea081290', 'type': 'feature_config', 'uuid': '1f9fbe3e-387a-4755-b94c-85618ea9f2dc'} 03/20/2025 01:53:55.088 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-601dbdef-f12e-424e-9bf2-d4e307d303db', 'type': 'alarm', 'uuid': 'ca5c7bd2-8580-4f61-9f45-597270fd3915'} 03/20/2025 01:53:55.136 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-d1baebdc-2a87-4a98-8243-98550f5dd652', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:53:55.185 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-63c78b39-4c63-4974-87bf-fdaab37b2c9a', 'type': 'node_profile', 'uuid': '4164eb8f-2292-46fc-a598-6109c75e61ee'} 03/20/2025 01:53:55.216 7fabb0fee0f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4396755a-d64c-45bd-87a1-90c9032cf6bc object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k-lean url = http://10.0.0.42:8082/node-profile/4396755a-d64c-45bd-87a1-90c9032cf6bc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"node-profile": {"uuid": "4396755a-d64c-45bd-87a1-90c9032cf6bc", "fq_name": ["default-global-system-config", "juniper-qfx10k-lean"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["Route-Reflector", "AR-Client"]}, {"physical_role": "spine", "rb_roles": ["lean", "Route-Reflector", "AR-Client", "AR-Replicator"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:55.242 7fabb18df198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9fc2de9a-a509-4f4c-ba90-38e77eb05d73 object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.42:8082/alarm/9fc2de9a-a509-4f4c-ba90-38e77eb05d73 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "9fc2de9a-a509-4f4c-ba90-38e77eb05d73", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:55.271 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'oper': 'UPDATE', 'request-id': 'req-dd891159-991c-4400-815e-aa3bab0eb77e', 'type': 'node_profile', 'uuid': '4396755a-d64c-45bd-87a1-90c9032cf6bc'} 03/20/2025 01:53:55.358 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-e6b0699e-372f-4d38-84b2-af90c1bf5b9f', 'type': 'node_profile', 'uuid': '80bfcdb7-a052-4c12-a3ac-4c07d8f464fa'} 03/20/2025 01:53:55.359 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-7e8522d8-4502-4179-8a6f-33c22da93495', 'type': 'alarm', 'uuid': '9fc2de9a-a509-4f4c-ba90-38e77eb05d73'} 03/20/2025 01:53:55.415 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-207814fb-907b-450c-be13-c1ec4c0a028e', 'type': 'node_profile', 'uuid': '552231da-108a-4ff3-9b6c-046ffcac8f18'} 03/20/2025 01:53:55.449 7fabb127f438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = abdf3f77-b2d2-4412-949f-61dd3db2e1c1 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = http://10.0.0.42:8082/node-profile/abdf3f77-b2d2-4412-949f-61dd3db2e1c1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"node-profile": {"uuid": "abdf3f77-b2d2-4412-949f-61dd3db2e1c1", "fq_name": ["default-global-system-config", "juniper-qfx10k"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "ERB-UCAST-Gateway", "DCI-Gateway", "CRB-MCAST-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "CRB-MCAST-Gateway", "DCI-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator", "Collapsed-Spine"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:55.503 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-9fb40f84-a71e-41a4-ae48-e4422e253b22', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 01:53:55.532 7fabb18df588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8b6abc1c-bd01-4612-85ab-0a0e23cecc68 object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.42:8082/alarm/8b6abc1c-bd01-4612-85ab-0a0e23cecc68 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "8b6abc1c-bd01-4612-85ab-0a0e23cecc68", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:55.579 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-ddeea06a-50a0-4ebc-acb3-37f6b4664923', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:53:55.603 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-75784e28-41cc-4eb3-be96-f6e48c43de74', 'type': 'alarm', 'uuid': '8b6abc1c-bd01-4612-85ab-0a0e23cecc68'} 03/20/2025 01:53:55.642 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-15631569-446f-4431-95ca-7c93addb5984', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 01:53:55.663 7fabb1127cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8cbae375-ce46-4b62-ac97-7bafa41a189a object_type = node_profile identifier_name = default-global-system-config:device-functional-group url = http://10.0.0.42:8082/node-profile/8cbae375-ce46-4b62-ac97-7bafa41a189a operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.42 body = {"node-profile": {"uuid": "8cbae375-ce46-4b62-ac97-7bafa41a189a", "fq_name": ["default-global-system-config", "device-functional-group"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "DCI-Gateway", "ERB-UCAST-Gateway", "CRB-MCAST-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "CRB-MCAST-Gateway", "DCI-Gateway", "ERB-UCAST-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator"]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:55.692 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'device-functional-group'], 'oper': 'UPDATE', 'request-id': 'req-138bbf27-a6aa-4f34-b315-609a83cbbf43', 'type': 'node_profile', 'uuid': '8cbae375-ce46-4b62-ac97-7bafa41a189a'} 03/20/2025 01:53:55.759 7fabb13f58d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = cc74187c-06a9-4d6b-8d8e-650afaf4a9e2 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.42:8082/alarm/cc74187c-06a9-4d6b-8d8e-650afaf4a9e2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "cc74187c-06a9-4d6b-8d8e-650afaf4a9e2", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:55.835 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-c736f727-66a1-496d-b155-f5c92b227ef6', 'type': 'alarm', 'uuid': 'cc74187c-06a9-4d6b-8d8e-650afaf4a9e2'} 03/20/2025 01:53:55.862 7fabb13b8978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.47 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:55.929 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-36d2bb46-6952-437d-8979-83dd911a9489', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:53:56.033 7fabb1147f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2c9b02ba-35bc-4d67-86d4-0e010edd049b object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.42:8082/alarm/2c9b02ba-35bc-4d67-86d4-0e010edd049b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "2c9b02ba-35bc-4d67-86d4-0e010edd049b", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:56.089 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-abec7b8f-15cd-4ef1-9b33-d8c15417f9c3', 'type': 'alarm', 'uuid': '2c9b02ba-35bc-4d67-86d4-0e010edd049b'} 03/20/2025 01:53:56.250 7fabb268ef60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bcb5ab76-d8ec-4914-b025-04833530d175 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.42:8082/alarm/bcb5ab76-d8ec-4914-b025-04833530d175 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "bcb5ab76-d8ec-4914-b025-04833530d175", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:56.352 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-7ebf05e6-cdb6-437a-bde6-9ba1bfdce4ee', 'type': 'alarm', 'uuid': 'bcb5ab76-d8ec-4914-b025-04833530d175'} 03/20/2025 01:53:56.464 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-4bad53ff-bedd-454e-946f-9aeef9db78dd', 'type': 'role_config', 'uuid': '10d96f31-4921-4c64-80b8-9ab8346db8f9'} 03/20/2025 01:53:56.554 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-dc5164f7-4c77-4fda-b54e-bb0dfbe67d04', 'type': 'role_config', 'uuid': '81f26b7b-14fd-4869-bc5e-2810c862bbd7'} 03/20/2025 01:53:56.640 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-33919d62-b46b-4ae4-8d3b-20a84f83cc29', 'type': 'role_config', 'uuid': '02b0ff29-f493-4f05-9939-4a1b92ead1a1'} 03/20/2025 01:53:56.707 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-556be947-cbed-46b9-8cc9-f281b844075e', 'type': 'role_config', 'uuid': '1a5697d5-f5d4-42f0-a8fb-3020e7a98ddf'} 03/20/2025 01:53:56.767 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-78438c55-593d-4208-8da5-b41aa7e23649', 'type': 'role_config', 'uuid': '1d98d6fb-ab5b-4d5b-b0d4-49bdc7e27147'} 03/20/2025 01:53:56.870 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-2200544e-97db-4b93-9edb-b3fbfb473bb7', 'type': 'role_config', 'uuid': 'cf88c5df-90ea-47de-88e1-bc6a9316e36a'} 03/20/2025 01:53:56.977 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-903225c5-dd83-40f8-9c14-0d63a004a195', 'type': 'role_config', 'uuid': 'ca36fc33-b0d6-4d9e-b244-df3d1369d7c0'} 03/20/2025 01:53:57.090 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-e2deb844-796c-42e5-a9a0-b80a81ebda63', 'type': 'role_config', 'uuid': 'cf3740c7-a8ce-4f25-b2b9-67aef99c36c0'} 03/20/2025 01:53:57.194 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-18d4605b-fdd2-45ef-ba12-67a5e7fc87f6', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 01:53:57.239 7fabb1fecc18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.47 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:57.263 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-a7555fa3-84f2-48c7-80a9-0489bf7276aa', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:53:57.303 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-873b3d80-63a4-4f68-aafa-85a02abe4999', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 01:53:57.405 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6e4245b5-b96f-41a9-b2a3-3b9829d0940f', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 01:53:57.535 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-552c7885-3078-4a30-9a3a-d5df3357e3e3', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 01:53:57.816 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a85588ea-a5fe-465a-b882-f810c3a5d10f', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 01:53:57.846 7fabb37d0438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.12 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:57.894 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5cc74037-dbba-4bc8-b575-4937909dff10', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 01:53:57.940 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-5fba8bf5-443c-45e4-9f58-e453ef31d665', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:53:58.007 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4b8eb1ba-acdf-44a4-8836-cd2805c32f6a', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 01:53:58.159 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-57dd8bb7-73a9-4460-bbd7-f0d684728ac7', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 01:53:58.256 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-03028ce1-185b-45db-9d0f-8d2c606d333c', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 01:53:58.366 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-bf63b560-3d65-4387-a679-1ffa97cbfc15', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 01:53:58.467 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-34aed6df-6d3e-4ea7-bd4f-604dfc81fef3', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 01:53:58.602 7fabb37d0cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/global-system-config/92e769a6-5754-45f5-bd68-145125efbf0e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"global-system-config": {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:58.610 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8be658e7-9f66-49fb-a34d-a4dec46aee1f', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 01:53:58.741 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-82e6e2d5-12f4-42c9-a1fc-91b38b84c296', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 01:53:58.793 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-98edceb3-54c6-48e5-b3b5-a9950bbac653', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 01:53:58.957 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-cd8212a5-5b46-4a1f-8683-92fd0c09305b', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 01:53:59.113 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-df1b81f2-dad4-4de5-be49-f14e6ff52c43', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 01:53:59.255 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d6f66813-4856-4c49-a322-0bab3d2de28a', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 01:53:59.305 7fabb13b8f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.12 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:53:59.338 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-a02d48ad-0502-432b-a6f2-c7dbdad1a505', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:53:59.390 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5aa73777-69b7-41b0-a2fb-2c8662fe3f84', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 01:53:59.564 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-44e5008e-4e01-40a4-affb-a88573b855c5', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 01:53:59.679 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-cd6f26da-7d38-401c-a723-f4c45d744674', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 01:53:59.798 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-336f1931-530b-4fe7-85e9-19358cb9bef2', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 01:53:59.933 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-74152bc4-a62a-4891-9fd6-3db164e6460c', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 01:54:00.097 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-7a40c494-a1bb-4369-afe5-370d0f60c065', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 01:54:00.177 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-73395ddf-2b81-48c5-8f12-6794b14c95e1', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 01:54:00.305 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-9d322521-ab37-4fd7-a6f7-d51a64599851', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 01:54:00.427 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-21c403fb-da16-4f63-aac7-a91a1c717ee3', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 01:54:00.494 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-6180c199-97ef-40db-992a-209c03cd7798', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 01:54:00.609 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-752a40f0-0a3d-4409-97d6-74fc45d76986', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 01:54:00.714 7fabc14c8ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/global-system-config/92e769a6-5754-45f5-bd68-145125efbf0e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"global-system-config": {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 03/20/2025 01:54:00.735 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-6452c479-c37a-415e-ac7f-f01e9a0ebf5d', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 01:54:00.791 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-03293435-9ea4-4acc-b933-e25834b27362', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 01:54:00.885 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-a675d980-f54f-4029-9149-8f5cfd282863', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 01:54:00.991 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8adc6f38-7319-476e-94e9-cf3e6e869410', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 01:54:01.101 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-893cc580-54d7-46be-ac6f-38abecd447e2', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 01:54:01.208 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8a4874f5-7636-491a-9e8d-3ceade093129', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 01:54:01.311 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-84f2c977-c445-443c-977a-cb2c19566717', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 01:54:01.444 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-55daaa31-f3c9-439f-b77d-7dc5a29087b6', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 01:54:01.585 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a10c0582-38b3-4c87-b474-a76145dc142c', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 01:54:01.651 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-50250f11-3cae-4acc-8134-1871172ee266', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 01:54:01.747 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4ac55194-7676-40ba-9ebb-97382006f9ea', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 01:54:01.848 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8cc44c1b-1434-4fc9-a0e1-f51959fc793c', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 01:54:01.939 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c076d715-e15b-448c-8301-b1ed51b38014', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 01:54:02.051 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-956fc757-6fd7-4259-ae34-741d672d21b9', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 01:54:02.153 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a7fa7a0f-27ed-4bee-a275-ced252515356', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 01:54:02.287 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-9b2b5c99-946a-4cc0-8ce7-3d16d1949d6d', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 01:54:02.382 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-77f63985-1650-4ad0-ba4a-6cc56a6909ac', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 01:54:02.484 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-f8913dc9-f9b7-464b-920d-54ef4bdf978f', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 01:54:02.578 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-72d905a2-41d0-4c41-b4b8-dd52a843b095', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 01:54:02.685 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-b1269a92-fc14-4c13-939c-5cf8dbbac80d', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 01:54:02.815 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-a659cf1a-d0d0-4d0b-aa5e-46d75b6e27f2', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 01:54:02.918 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-7535cde7-8b86-4dd2-9729-6b4acf904543', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 01:54:03.005 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-589de528-a924-4d6f-9755-766853071c50', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 01:54:03.347 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-12677589-232a-43b2-acbd-c93a50d6b154', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 01:54:03.412 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7f47b773-eb01-4725-bad5-fb162ea07d44', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 01:54:03.497 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-aa728fe0-0c04-4bd0-a705-d39247670a7a', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 01:54:03.587 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f5b340da-1256-483c-b8a3-92eb34f539ab', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 01:54:03.693 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f45d70d8-2b9d-43c4-bec3-71cbfdec3784', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 01:54:03.794 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5862e674-60b9-4f66-bf2d-ff2511eb9549', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 01:54:03.886 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-fdbe7832-253b-4cd1-a9f7-a082f8a3c939', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 01:54:03.984 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d7b516f3-4d81-4695-80e0-74da803b0d87', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 01:54:04.073 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-704faf79-7e04-4904-88d1-b064019d5548', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 01:54:04.171 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-893df2bf-6a41-463e-847d-7e10923f2e4a', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 01:54:04.268 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-0fb345a6-0e65-441b-8b39-0aad0fade27e', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 01:54:04.359 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-0d16ba2d-8da7-4eba-bad9-2b1d543ae40a', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 01:54:04.453 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-27bdc734-cf8a-4ee8-8658-c5b067a11220', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 01:54:04.536 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-1daa31e5-de41-49bf-8c51-0eb1828fe8db', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 01:54:04.628 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-7411b894-91eb-4ff2-a831-da9004fe9eb9', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 01:54:04.760 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-555e83be-8946-4518-8c3a-cf99dc91e898', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 01:54:04.823 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-c27e3b69-3d92-462d-9ae9-a1d84495d1a4', 'type': 'role_definition', 'uuid': '8c6c638e-bbb4-4c25-b33e-52e56d8d42f7'} 03/20/2025 01:54:04.911 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-38613221-02be-474f-b2cb-6861edda8d30', 'type': 'role_definition', 'uuid': '8c6c638e-bbb4-4c25-b33e-52e56d8d42f7'} 03/20/2025 01:54:05.010 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-d46e2703-19f5-4532-8a66-296c97a29c9f', 'type': 'role_definition', 'uuid': '8c6c638e-bbb4-4c25-b33e-52e56d8d42f7'} 03/20/2025 01:54:05.103 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-5c287e94-a9b8-4592-97b4-2593a9519d43', 'type': 'role_definition', 'uuid': '8c6c638e-bbb4-4c25-b33e-52e56d8d42f7'} 03/20/2025 01:54:05.194 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-6b41267d-a99b-464c-b93c-e9665a0726b5', 'type': 'role_definition', 'uuid': '8c6c638e-bbb4-4c25-b33e-52e56d8d42f7'} 03/20/2025 01:54:05.306 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-afceb0d2-d48a-46ec-943d-2ad484e5bf66', 'type': 'role_definition', 'uuid': '5599512a-2561-4b35-9fd2-a137f3470b47'} 03/20/2025 01:54:05.442 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-3cb04842-2d03-415d-9ff3-ca49e15acb0f', 'type': 'role_definition', 'uuid': '5599512a-2561-4b35-9fd2-a137f3470b47'} 03/20/2025 01:54:05.510 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-ba350595-727a-4c63-be09-f1ebb7d28807', 'type': 'role_definition', 'uuid': '5599512a-2561-4b35-9fd2-a137f3470b47'} 03/20/2025 01:54:05.620 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-757c5a38-d05b-4a52-a55d-0ab60b9c266e', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 01:54:05.725 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0ee6f44a-d877-4553-93d4-8d16021416c5', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 01:54:05.814 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-cb52cc57-f02b-423b-b553-3a11399cfcac', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 01:54:05.902 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a78df496-57ec-4079-a38d-2a611c151ea7', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 01:54:05.992 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-12831ab6-9c7f-4c4c-bab9-16055f186f1b', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 01:54:06.095 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-87bda2ad-5904-4b9a-961c-37000ff61568', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 01:54:06.190 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ccc298d2-68c2-41f9-b01b-46f896e9617a', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 01:54:06.396 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0d4d67c6-efa0-4cba-8e53-41d6201cd052', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 01:54:06.451 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-70e0057c-c96c-462d-a5e0-86ed87727b9e', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 01:54:06.550 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e1a9f571-ad86-41a0-8fb6-216a3947ef20', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 01:54:06.665 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8d99ae9b-131c-4a7d-a21f-bba05c95042e', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 01:54:06.749 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-df9db008-debb-463d-870f-e98758590020', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 01:54:06.845 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-1279f1fc-95d3-4c01-a8a7-75ce16acfee1', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 01:54:06.949 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-7894b464-4906-4a0c-a964-571fa1fe6389', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 01:54:07.045 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-765bb5e8-0c5f-4540-b0a5-a855cc8bb073', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 01:54:07.148 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-ca392078-5d95-4af1-be88-4ba69e645cb8', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 01:54:07.282 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-92ac8fc9-077f-4c82-b367-4fb73b198f6a', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 01:54:07.368 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d8beee5e-7247-40e7-b3b9-ce3b6e46b019', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 01:54:07.448 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-11398bcd-74e4-439b-ad25-e0b5c26b35b6', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 01:54:07.535 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f60d97eb-08c4-4c3b-ba4f-3a7d09bba108', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 01:54:07.650 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8025c3d8-4e0c-4f62-9283-5f36a20096c0', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 01:54:07.778 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5ef4ddaf-ac09-4455-9516-6f0be6f6c0de', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 01:54:07.876 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-748dded0-3a4a-421c-9517-5dd1336d482d', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 01:54:07.974 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-62e4e1e2-9b8e-4ed5-b13c-eb07e268be0c', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 01:54:08.086 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3c586bc3-59d2-4e35-a6d8-45fb538f5997', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 01:54:08.220 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ac355b48-df29-413c-8cc2-1f884425c338', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 01:54:08.376 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3a0cbc30-a55a-4916-801a-a62ba1025205', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 01:54:08.479 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-4ec3ccaa-f4c9-4f58-b9c0-d86c6319ac69', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 01:54:08.590 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-17731665-f278-4cf8-ae54-23e5b18bb61c', 'type': 'role_definition', 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'} 03/20/2025 01:54:08.684 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-09e46b6a-0612-4701-8adc-3f30d8da216f', 'type': 'role_definition', 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'} 03/20/2025 01:54:08.812 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ea098331-79eb-4607-a717-a24748c80491', 'type': 'role_definition', 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'} 03/20/2025 01:54:08.883 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-2f2705b8-a643-45ed-b553-09b4d04e1fe4', 'type': 'role_definition', 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'} 03/20/2025 01:54:08.986 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-a4062be4-034b-41d5-8521-4aee69e5bf5a', 'type': 'role_definition', 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'} 03/20/2025 01:54:09.047 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-debfd10f-bb77-4bf0-94fc-1e7c05c568df', 'type': 'role_definition', 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'} 03/20/2025 01:54:09.165 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-121b264e-898c-4868-adad-3880de3cefa9', 'type': 'role_definition', 'uuid': '4441e96d-2282-4154-a145-b28430c80f2c'} 03/20/2025 01:54:09.291 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f592b890-afb1-4feb-998c-6b79e5f288b8', 'type': 'role_definition', 'uuid': '4441e96d-2282-4154-a145-b28430c80f2c'} 03/20/2025 01:54:09.415 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-1a38d53f-8672-4bd8-bc22-ded246edd881', 'type': 'role_definition', 'uuid': 'c9fce0d0-672c-43f8-a28b-6d126af91fcb'} 03/20/2025 01:54:09.529 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-4e9a23f4-c0bb-41d6-af94-52ed3168a14c', 'type': 'role_definition', 'uuid': 'c9fce0d0-672c-43f8-a28b-6d126af91fcb'} 03/20/2025 01:54:09.635 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-158eda68-1aee-4c9b-b71c-0bf6524abbfc', 'type': 'role_definition', 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'} 03/20/2025 01:54:09.737 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3fe20ef9-40fb-4fb7-a1f8-de36f7d89987', 'type': 'role_definition', 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'} 03/20/2025 01:54:09.875 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-921257ea-d48c-4826-a86d-2fcf972f15c5', 'type': 'role_definition', 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'} 03/20/2025 01:54:09.981 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-fa926607-3224-4068-a7c6-3d9aad0229f4', 'type': 'role_definition', 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'} 03/20/2025 01:54:10.079 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c40749d6-2585-4ea9-8a17-9b022181a680', 'type': 'role_definition', 'uuid': '4441e96d-2282-4154-a145-b28430c80f2c'} 03/20/2025 01:54:10.184 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-fdd905a4-d79a-4d51-856b-d888eed80421', 'type': 'role_definition', 'uuid': '4441e96d-2282-4154-a145-b28430c80f2c'} 03/20/2025 01:54:10.294 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-34a50ba3-2f21-40a0-bed7-3f50bdc9095b', 'type': 'role_definition', 'uuid': 'c9fce0d0-672c-43f8-a28b-6d126af91fcb'} 03/20/2025 01:54:10.418 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-a73ea28c-8763-4913-8bdc-c2442396ffc2', 'type': 'role_definition', 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'} 03/20/2025 01:54:10.497 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-d98af039-3368-4508-9377-d93a487331fd', 'type': 'role_definition', 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'} 03/20/2025 01:54:10.570 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f887e7b4-bfd2-4d34-9c51-46be84c5643f', 'type': 'role_definition', 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'} 03/20/2025 01:54:10.672 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-20f80675-272c-482f-9bee-d8839f9ca203', 'type': 'role_definition', 'uuid': 'c9fce0d0-672c-43f8-a28b-6d126af91fcb'} 03/20/2025 01:54:10.780 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-749a5b15-4f86-4d62-abcc-ef9eb2d57583', 'type': 'role_definition', 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'} 03/20/2025 01:54:10.891 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-9ef98664-8982-4b6d-aa4c-e7f1de9d70f3', 'type': 'role_definition', 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'} 03/20/2025 01:54:10.993 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-053d8a99-7630-4cd1-b489-cd1a13552006', 'type': 'role_definition', 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'} 03/20/2025 01:54:11.108 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-8cc41c55-86f8-42f4-82a4-49f003500a1a', 'type': 'role_definition', 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'} 03/20/2025 01:54:11.223 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-543e1e1d-d8d6-4402-9af7-3314810d5b0b', 'type': 'role_definition', 'uuid': '35e70721-3adc-4580-ae4a-904e96a85476'} 03/20/2025 01:54:11.331 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-0cef2df0-5626-4156-a474-fd9f2c64bd76', 'type': 'role_definition', 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'} 03/20/2025 01:54:11.412 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-d1e531f2-54ed-4b56-8ee2-4ebceeed7a9c', 'type': 'role_definition', 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'} 03/20/2025 01:54:11.586 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-f394fca7-d8a7-4b2c-8ef8-9fea219ae843', 'type': 'role_definition', 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'} 03/20/2025 01:54:11.630 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-b8613839-4967-4cbf-ab9f-1c163385ef6c', 'type': 'role_definition', 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'} 03/20/2025 01:54:11.716 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-230ae7c0-76ff-47e1-bdee-7a00614588fe', 'type': 'role_definition', 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'} 03/20/2025 01:54:11.800 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-90c46135-a7a1-488b-af4c-6b58915a47a9', 'type': 'role_definition', 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'} 03/20/2025 01:54:11.888 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1a937dbd-6ce9-4089-b5d2-5d63cbda0fd8', 'type': 'role_definition', 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'} 03/20/2025 01:54:11.973 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-af9469b2-ce18-4e55-87cc-0410e8eac535', 'type': 'role_definition', 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'} 03/20/2025 01:54:12.059 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0a60c861-a8a3-467c-af39-2f3f9798a8a1', 'type': 'role_definition', 'uuid': 'fad1e96f-8862-4fab-bb10-aa63d51ee561'} 03/20/2025 01:54:12.145 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-534f14bf-d402-44e9-8d0b-3e289d9ab474', 'type': 'role_definition', 'uuid': '29c66905-1418-4dd7-8013-34e78036e6ce'} 03/20/2025 01:54:12.228 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-bd9e3a9d-aa98-4e02-a9ea-71ed60868e05', 'type': 'role_definition', 'uuid': '8c566ae8-75e7-4e69-81a7-d2c2c52fd0be'} 03/20/2025 01:54:12.322 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-1f782e00-6815-4804-a77a-2327274cdd4a', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 01:54:12.409 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e3dd3a08-818a-484e-b6f7-30ec6f4ed789', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 01:54:12.494 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d15ec673-6d7a-460d-b357-c787f2964ead', 'type': 'role_definition', 'uuid': 'f0baa455-a92a-4c48-b998-bcd427343e6f'} 03/20/2025 01:54:12.582 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-ee9f923e-defd-4065-991e-16813829028f', 'type': 'role_definition', 'uuid': '1a95670f-1da7-468c-a621-293f19ff5e2f'} 03/20/2025 01:54:12.680 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ac01a1b5-0328-4859-acd3-d39e3887e1f4', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 01:54:12.772 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f2998d5a-3913-423e-a599-a76581b37710', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 01:54:12.856 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e4eb3644-f38b-483f-9c99-1e872e61d66e', 'type': 'role_definition', 'uuid': 'bb538855-e8a8-41c9-b00f-5a55257e7cf2'} 03/20/2025 01:54:12.944 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-bd4b7c61-3567-4ead-a521-292100d09845', 'type': 'role_definition', 'uuid': 'afff3d51-5def-4b18-9404-3fefb2935eb5'} 03/20/2025 01:54:13.034 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ca1fe19d-da96-485a-af24-d4960540770f', 'type': 'role_definition', 'uuid': '4441e96d-2282-4154-a145-b28430c80f2c'} 03/20/2025 01:54:13.126 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-aa310e62-937f-4a5e-b294-7e5794beabb4', 'type': 'role_definition', 'uuid': 'c9fce0d0-672c-43f8-a28b-6d126af91fcb'} 03/20/2025 01:54:13.220 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7977cd29-ea1c-4758-afdd-7c8eaeb511a6', 'type': 'role_definition', 'uuid': '9c798d45-0b2c-4ca9-91db-6944cdbcdb41'} 03/20/2025 01:54:13.318 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-52876623-2bcb-447b-b506-cc562a1f18a1', 'type': 'role_definition', 'uuid': 'bbd1270c-2297-4d0a-bc4e-c5aa5a923e10'} 03/20/2025 01:54:13.402 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-29b8bbbf-c2b4-46fd-9985-f7f36c2ea6ac', 'type': 'role_definition', 'uuid': '728e4e7e-bf64-4d72-bb64-c75977af55b6'} 03/20/2025 01:54:13.492 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0d64b789-aa3a-4c3e-8b9b-372eaed3dd3c', 'type': 'role_definition', 'uuid': 'edf8da1e-1590-48a9-8480-66bcae438a53'} 03/20/2025 01:54:13.587 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-1973a0ab-8634-4414-bc41-35fc6cff522b', 'type': 'role_definition', 'uuid': '5599512a-2561-4b35-9fd2-a137f3470b47'} 03/20/2025 01:54:13.691 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-4ec787e3-2048-4409-8468-064564f0a183', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 01:54:13.777 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-62b7f68c-b66f-499c-abef-1662abe274d8', 'type': 'role_definition', 'uuid': 'bbdee73d-ee96-4741-80b8-6787a2819670'} 03/20/2025 01:54:13.870 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-bdef2ecd-1c4a-4406-97df-14e6719fed19', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 01:54:13.974 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0de22772-ec5e-4d4a-a2d3-0d390afb56a4', 'type': 'role_definition', 'uuid': 'e21727ee-f7c6-47ab-b972-cc324d2970e4'} 03/20/2025 01:54:14.061 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-1c58ef61-0280-4049-8a14-e48a60a89f31', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 01:54:14.150 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-94a8999f-9afa-4057-8223-a640ae3eb3ed', 'type': 'role_definition', 'uuid': '29269d01-b04e-44db-9eee-019d549f7157'} 03/20/2025 01:54:14.248 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-9c650b64-a3a0-430d-8341-b8cca8d16f48', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 01:54:14.340 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-798b6a31-5ad4-47dd-8a2a-e57c56790d20', 'type': 'role_definition', 'uuid': 'c4d1624b-5ac2-4659-8cb9-9939ec42b8ea'} 03/20/2025 01:54:14.427 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-af04c6e4-3b6f-4638-a466-f8c60d3dd2c2', 'type': 'role_definition', 'uuid': '5599512a-2561-4b35-9fd2-a137f3470b47'} 03/20/2025 01:54:14.517 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-806a8cd5-854d-4808-b639-28e88315041e', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 01:54:14.605 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-20b35fe1-19b1-4838-af18-b5bcdc32680d', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 01:54:14.693 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-53767827-b869-4f81-b47b-663159ec3d70', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 01:54:14.776 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-b552fc97-c824-4d32-8fcd-7321619a6d57', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 01:54:14.873 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-04318193-c825-47b2-a9b1-4e79899d1b6e', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 01:54:14.961 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-f75ca469-8b83-45c6-9604-7d47555ac736', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 01:54:15.055 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-8fb43ddb-95d3-4d9d-b60c-63fc214de3ef', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 01:54:15.145 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-5f61eeee-01d0-467f-bc33-f40b8d78c76f', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 01:54:15.240 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-65beff31-da8d-40c2-a76c-2fcedf0d8ee7', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 01:54:15.333 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-0c34d519-c6b6-4891-9aa6-2e973cd7d9d8', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 01:54:15.426 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-eb7267b6-346a-4960-a9cf-e623bdc7861c', 'type': 'role_definition', 'uuid': 'ed79f827-69d7-4efe-8849-b59ed841e4e5'} 03/20/2025 01:54:15.526 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-ec0c388e-ef4b-4cac-a49c-4b1e7d64b636', 'type': 'role_definition', 'uuid': '497e1087-553f-474a-a3e1-980bcbab6811'} 03/20/2025 01:54:15.618 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-26368892-eede-4187-adc2-2fd1eab9787b', 'type': 'role_definition', 'uuid': '9dd9ebf4-7da7-464c-82d2-83006561567f'} 03/20/2025 01:54:15.700 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-cc75eae3-a5a4-48fc-9049-1e3a6b0853af', 'type': 'role_definition', 'uuid': 'd18b1b93-9d78-4930-827f-c4c6e3b9d639'} 03/20/2025 01:54:15.783 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-be043528-b82f-44b9-88c7-966eb3bb76f4', 'type': 'role_definition', 'uuid': '497e1087-553f-474a-a3e1-980bcbab6811'} 03/20/2025 01:54:15.871 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-d4647a22-e97b-4ece-b544-41e1c5c87815', 'type': 'role_definition', 'uuid': '9dd9ebf4-7da7-464c-82d2-83006561567f'} 03/20/2025 01:54:15.960 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0fb91d4e-7e3c-4834-904b-8116120837bd', 'type': 'role_definition', 'uuid': 'd18b1b93-9d78-4930-827f-c4c6e3b9d639'} 03/20/2025 01:54:16.050 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-6b0704b1-c716-4765-95ee-b41e042656fe', 'type': 'role_definition', 'uuid': '497e1087-553f-474a-a3e1-980bcbab6811'} 03/20/2025 01:54:16.152 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-e1cbecd0-f6a8-436a-91db-78ee408d1bb0', 'type': 'role_definition', 'uuid': '9dd9ebf4-7da7-464c-82d2-83006561567f'} 03/20/2025 01:54:16.250 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-317a1361-7d57-4cbd-a002-a8e91839f779', 'type': 'role_definition', 'uuid': 'd18b1b93-9d78-4930-827f-c4c6e3b9d639'} 03/20/2025 01:54:16.349 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-c550d2c3-93ed-4836-993b-02e01ae187bb', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:16.434 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-775cd0aa-b04e-48b1-bebc-f628e5ecbdd7', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:16.523 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-d2e3f5f7-c022-4fe6-ac91-8c75b7284fcb', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:16.628 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-9e84000f-387d-4c7c-b03d-19743e26cbdc', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:16.726 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-ecea39b3-4107-4575-9060-4e385804209b', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:16.819 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-6f7dcbcf-f2ff-4867-af4f-da739a0edd6c', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:16.910 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-f52f46c8-ce18-439a-8964-5876334ea3d7', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:16.999 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-7518083b-1ec0-4f6e-840d-756031b57267', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:17.086 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-e584658a-3c8f-4d53-be3b-83d3d1aef4a8', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:17.170 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-3031c768-1d84-432a-b58a-beb36bf5f9d6', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:17.257 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-518f8bcd-1367-44d0-b097-e1a8d3e2aebf', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:17.358 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-5c09d06c-584e-4842-ad00-b01b983d2a95', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:17.453 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-07c14614-e32f-45b9-829a-2c993bfbca84', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:17.562 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-eefc7b03-8328-44b5-b3ee-599b5ca77837', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:17.654 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-f987aa0f-9841-4ed2-bfdf-52ec2f0119b1', 'type': 'node_profile', 'uuid': '4164eb8f-2292-46fc-a598-6109c75e61ee'} 03/20/2025 01:54:17.757 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-16e0d1d6-0013-4801-8048-c74d0340adeb', 'type': 'node_profile', 'uuid': '4164eb8f-2292-46fc-a598-6109c75e61ee'} 03/20/2025 01:54:17.861 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-e89508af-64d7-436c-b8a8-d7333789fd2c', 'type': 'node_profile', 'uuid': '80bfcdb7-a052-4c12-a3ac-4c07d8f464fa'} 03/20/2025 01:54:17.962 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-32327d32-bf42-43f0-bc30-0429d2ab3127', 'type': 'node_profile', 'uuid': '80bfcdb7-a052-4c12-a3ac-4c07d8f464fa'} 03/20/2025 01:54:18.054 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-98cbfe5b-0bde-47b7-889a-4ff25bf4c3fb', 'type': 'node_profile', 'uuid': '80bfcdb7-a052-4c12-a3ac-4c07d8f464fa'} 03/20/2025 01:54:18.157 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-33a9752b-c07b-40ae-bb01-415153019471', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:18.248 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-69910972-bdd6-43da-a71f-d5d5c0bc6811', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:18.348 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-7e35e44c-32d8-4608-aea8-37800832abc4', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:18.438 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-25acba18-0e6c-41e8-8079-d10107812020', 'type': 'node_profile', 'uuid': '552231da-108a-4ff3-9b6c-046ffcac8f18'} 03/20/2025 01:54:18.533 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-9621b85a-ab2e-429a-b186-8f393d5f917c', 'type': 'node_profile', 'uuid': '552231da-108a-4ff3-9b6c-046ffcac8f18'} 03/20/2025 01:54:18.628 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-5df20e7a-df4d-4e48-945f-eaa5b281a76e', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 01:54:18.713 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-ae6ecdf1-1257-4ec2-b394-ced4e0a6f356', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 01:54:18.800 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-6244c769-335f-4d1a-9d2a-0b1495263180', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 01:54:18.880 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-75f70ed6-fe1d-437d-9a76-75d560bb56df', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 01:54:18.965 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-bb46490a-a4e2-40b4-b0bc-7ac3bb39f470', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 01:54:19.052 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-fe541845-f9cc-4d35-b1a2-129b95e23054', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 01:54:19.152 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-e0a80d2f-c28f-451f-adaf-fe761d0a2921', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:19.240 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-5ada2fb7-b1a0-47e3-867a-749a7ec9a39b', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:19.326 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-2f7fb4fd-8db1-4441-a936-01666b3faae2', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:19.413 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-742c3c9f-462a-4949-97ec-814759d22baa', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:19.488 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-268a133d-0c3a-4934-b82c-3824d7003417', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:19.597 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-0afe3118-7830-45bf-8870-6850d83aa6b5', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:19.696 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-2d5d03be-1fac-417d-a229-cf28e783b57e', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:19.783 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-b61e1d8f-30aa-4c3d-a4d0-852bd42a6d84', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:19.882 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-20533f10-917f-4674-96d7-c148435eb645', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:19.986 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-fe8b525a-9a6b-4cba-99f6-41da3c90d9b0', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:20.081 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-70da2eaf-bc59-463e-b33f-dbbc2d34addd', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:20.176 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-f4643b84-fc02-4a16-8804-e7b2ccf4a779', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:20.268 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-be1808c0-821c-4dbe-8ccc-30261ebfbb8d', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:20.351 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-7caecb32-d71f-4129-be90-a7db2de51a74', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 01:54:20.446 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-7fac6e86-971c-47ab-847b-77f254dc2841', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 01:54:20.538 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-9a1d5495-2d30-42f6-a1f1-613addcc4f92', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 01:54:20.620 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-4dc1de45-619d-4778-afcd-070021a11c81', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 01:54:20.714 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-813bbc28-dec1-4194-bdda-7a2410752f37', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 01:54:20.808 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-48e82486-97c0-424d-8b7f-bde5b2f8527f', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 01:54:20.886 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-d1067cbb-5848-49bf-92f1-cd9806241d3e', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 01:54:20.974 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-a2eb207d-64bf-4e9a-8a46-0d4386ff2394', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 01:54:21.068 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-afc94c7f-3c08-469d-8fce-bf5387db8e2f', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 01:54:21.152 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-b3699118-340d-4322-8d27-3c57fbd3ad7e', 'type': 'node_profile', 'uuid': '4164eb8f-2292-46fc-a598-6109c75e61ee'} 03/20/2025 01:54:21.243 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-d53f99db-1b73-4460-9996-b1704cb8a066', 'type': 'node_profile', 'uuid': '4164eb8f-2292-46fc-a598-6109c75e61ee'} 03/20/2025 01:54:21.331 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-e19939ef-2888-48a3-9973-1b31aaad733c', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:21.416 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-1b7c11a6-a84b-4e20-bc8a-9c246a363715', 'type': 'node_profile', 'uuid': '9166d618-21ce-4a05-bef6-98ad00b9ff32'} 03/20/2025 01:54:21.504 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-13f3154c-1c3b-45b0-84ad-ebac16766ce9', 'type': 'node_profile', 'uuid': '4164eb8f-2292-46fc-a598-6109c75e61ee'} 03/20/2025 01:54:21.599 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-54952908-2850-447a-bee5-8ee68c983892', 'type': 'node_profile', 'uuid': '80bfcdb7-a052-4c12-a3ac-4c07d8f464fa'} 03/20/2025 01:54:21.681 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-30db2467-a6c5-4c3f-9e29-0a4b92a4d839', 'type': 'node_profile', 'uuid': '552231da-108a-4ff3-9b6c-046ffcac8f18'} 03/20/2025 01:54:21.766 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'oper': 'UPDATE', 'request-id': 'req-f646f0b4-6d85-4bdd-8e89-4002c9c2904a', 'type': 'node_profile', 'uuid': '4396755a-d64c-45bd-87a1-90c9032cf6bc'} 03/20/2025 01:54:21.849 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-e25cedc0-9de0-42fa-a5fa-75d8a1790f2c', 'type': 'node_profile', 'uuid': 'abdf3f77-b2d2-4412-949f-61dd3db2e1c1'} 03/20/2025 01:54:21.929 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-eece8a8b-d2f0-4dca-99d7-9570a4924160', 'type': 'node_profile', 'uuid': 'b8524210-90b0-4ce2-9c1b-52650b85ec84'} 03/20/2025 01:54:22.032 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-796a2232-ef16-4fe6-8645-888f25fa00ed', 'type': 'node_profile', 'uuid': 'c68998fb-53d4-4962-b30f-d5685582dd33'} 03/20/2025 01:54:22.132 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'oper': 'UPDATE', 'request-id': 'req-4fc07871-2a68-43e9-beb4-a2127e836769', 'type': 'telemetry_profile', 'uuid': '233df893-e2c1-487b-b00a-013bc77ceb00'} 03/20/2025 01:54:22.226 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'oper': 'UPDATE', 'request-id': 'req-ea1ee655-c3d3-4b0b-82b3-85a23696d5ff', 'type': 'telemetry_profile', 'uuid': '510b8761-b72d-4700-aaeb-67ddf9786d3c'} 03/20/2025 01:54:22.320 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'oper': 'UPDATE', 'request-id': 'req-9f5f42e5-db79-4626-99ab-8163ad9a0e71', 'type': 'telemetry_profile', 'uuid': '43aa9aba-ef66-4d49-a60c-349a7542015d'} 03/20/2025 01:54:22.410 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'oper': 'UPDATE', 'request-id': 'req-c6fbc34a-1382-4345-afef-3a0ae0dc45d9', 'type': 'telemetry_profile', 'uuid': '8739b957-e63d-4482-9422-cc239a4f5c89'} 03/20/2025 01:54:22.498 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'oper': 'UPDATE', 'request-id': 'req-52ccea13-adda-4987-90fa-69c2c47b2c1c', 'type': 'telemetry_profile', 'uuid': '9485accd-5f23-419d-897d-2f98015c444a'} 03/20/2025 01:54:22.602 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'oper': 'UPDATE', 'request-id': 'req-17a6f4a2-ad05-4afd-bdd7-819850532a07', 'type': 'telemetry_profile', 'uuid': 'f3127827-9eb2-48e8-b84a-a51ad3adb702'} 03/20/2025 01:54:22.733 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-35161e8c-f8fe-4ae7-a8a8-116b3fd4d6cf', 'type': 'device_functional_group', 'uuid': 'fd03f171-eb0f-40a3-9686-4e88bc51db09'} 03/20/2025 01:54:22.820 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-182d0d36-2e5d-427e-b070-161c85ce2fd5', 'type': 'device_functional_group', 'uuid': '22d2163e-3227-4b4a-bd9c-9b8a9ef961d1'} 03/20/2025 01:54:22.920 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'oper': 'UPDATE', 'request-id': 'req-de5157d4-cf72-46a7-871e-ef2a505193e8', 'type': 'device_functional_group', 'uuid': '156fd638-e4cc-47cc-bc7c-bcd53b08eaae'} 03/20/2025 01:54:23.035 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'oper': 'UPDATE', 'request-id': 'req-6a69e339-dfd4-4432-868c-2500df6e231e', 'type': 'device_functional_group', 'uuid': '14f01305-cf08-4af9-82bd-9eb645daa4cb'} 03/20/2025 01:54:23.164 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'oper': 'UPDATE', 'request-id': 'req-5cf3835c-ec59-49e8-b7f1-68c066a3ce46', 'type': 'device_functional_group', 'uuid': 'c297d55e-5d29-46a3-bfdd-9a05637df6fa'} 03/20/2025 01:54:23.257 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'oper': 'UPDATE', 'request-id': 'req-451c1350-9f8a-4721-b9f9-0cf93b3cda28', 'type': 'device_functional_group', 'uuid': '178a85e6-94ec-478d-b4d1-e0ef2a2562c6'} 03/20/2025 01:54:23.358 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'oper': 'UPDATE', 'request-id': 'req-4d4b05ce-db32-4595-804f-bb5146895809', 'type': 'device_functional_group', 'uuid': 'c065af7d-7508-4dfb-90a2-d225a6a58393'} 03/20/2025 01:54:23.446 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'oper': 'UPDATE', 'request-id': 'req-bc6f45a2-6aa3-4efe-b67d-871ec98a58ea', 'type': 'device_functional_group', 'uuid': 'dfc6fee9-c402-4769-81a1-b40284cd32f4'} 03/20/2025 01:54:23.543 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-ec7af6fb-3229-4c2e-b7b3-2df2dd8b9321', 'type': 'device_functional_group', 'uuid': '03491239-e863-4c4b-8840-e6322951d25d'} 03/20/2025 01:54:23.643 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'oper': 'UPDATE', 'request-id': 'req-f27ef604-daab-429e-9dd9-e5c8791d91e4', 'type': 'device_functional_group', 'uuid': '8e9ee7de-b53b-4d77-8e4d-f8aa2c277fc9'} 03/20/2025 01:54:23.766 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'oper': 'UPDATE', 'request-id': 'req-f131e18f-f1da-49bc-a730-777ed00cebea', 'type': 'network_ipam', 'uuid': '98f5b8a6-3f1b-4967-8a1a-82c848d3cd73'} 03/20/2025 01:54:23.910 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'], 'oper': 'UPDATE', 'request-id': 'req-9cb88164-643c-4f38-bf66-f3c0a1a382f3', 'type': 'virtual_network', 'uuid': '826220c5-748a-4986-b4b8-2a6455c02f53'} 03/20/2025 01:54:24.000 7fabc2645d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'oper': 'UPDATE', 'request-id': 'req-9cb88164-643c-4f38-bf66-f3c0a1a382f3', 'type': 'routing_instance', 'uuid': '392cd136-94c1-46e8-8573-1d3de7439890'} 03/20/2025 01:55:31.533 7fabcc3c1508 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Removing queue amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy 03/20/2025 01:57:05.126 7f8c233eb2c8 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/20/2025 01:57:05.126 7f8c233eb2c8 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/20/2025 01:57:05.126 7f8c233eb2c8 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/20/2025 01:57:05.127 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.42:2181,10.0.0.12:2181,10.0.0.47:2181 03/20/2025 01:57:05.127 7f8c233eb2c8 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 01:57:05.128 7f8c1d7f0eb8 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 03/20/2025 01:57:05.128 7f8c1d7f0eb8 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 03/20/2025 01:57:05.128 7f8c1d7f3828 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 03/20/2025 01:57:05.128 7f8c1d7f3828 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:57:05.129 7f8c1d7f3828 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/20/2025 01:57:05.129 7f8c1d7f3828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.129 7f8c1d7f3828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 03/20/2025 01:57:05.129 7f8c1d7f3828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.129 7f8c1d7f3828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.129 7f8c1d7f3828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:57:05.129 7f8c1d7f3828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.129 7f8c1d7f3828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.129 7f8c1d7f3828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742435825128799 collector_name = collector_ip = collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 03/20/2025 01:57:05.129 7f8c1d7f3828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.144 7f8c1e0600f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.144 7f8c1e0600f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:57:05.144 7f8c1e0600f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.184 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.42:9041', '10.0.0.12:9041', '10.0.0.47:9041'] 03/20/2025 01:57:05.184 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 03/20/2025 01:57:05.184 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 03/20/2025 01:57:05.184 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 03/20/2025 01:57:05.184 7f8c1e076048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.185 7f8c1e076048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/20/2025 01:57:05.185 7f8c1e076048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.186 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 03/20/2025 01:57:05.244 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 03/20/2025 01:57:05.245 7f8c1e182c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.245 7f8c1e182c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/20/2025 01:57:05.245 7f8c1e182c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.260 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 03/20/2025 01:57:05.261 7f8c1e0d2ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.262 7f8c1e0d2ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/20/2025 01:57:05.262 7f8c1e0d2ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.270 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 03/20/2025 01:57:05.328 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 03/20/2025 01:57:05.329 7f8c1d1e5438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.329 7f8c1d1e5438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:57:05.329 7f8c1d1e5438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.426 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.42:5673//', 'pyamqp://guest:guest@10.0.0.12:5673//', 'pyamqp://guest:guest@10.0.0.47:5673//'] 03/20/2025 01:57:05.436 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 03/20/2025 01:57:05.436 7f8c1d811cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.437 7f8c1d811cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 01:57:05.437 7f8c1d811cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.437 7f8c1d811cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.437 7f8c1d811cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 01:57:05.437 7f8c1d811cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.448 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 03/20/2025 01:57:05.449 7f8c1d1ef8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.449 7f8c1d1ef8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:57:05.449 7f8c1d1ef8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.617 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 03/20/2025 01:57:05.618 7f8c1d856588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.618 7f8c1d856588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 01:57:05.618 7f8c1d856588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.621 7f8c233eb2c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 03/20/2025 01:57:05.622 7f8c1d828f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.622 7f8c1d828f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:57:05.622 7f8c1d828f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.623 7f8c1d828e10 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 03/20/2025 01:57:05.623 7f8c1d85b588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.623 7f8c1d85b588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 01:57:05.624 7f8c1d85b588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.628 7f8c1d828e10 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 03/20/2025 01:57:05.628 7f8c1d74d630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:05.628 7f8c1d74d630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:57:05.628 7f8c1d74d630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.056 7f8c22f8bb70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Executing db_resync on api-server instance 10.0.0.42_0 03/20/2025 01:57:06.056 7f8c22f8bb70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Contrail Version is(nightly) 03/20/2025 01:57:06.252 7f8c1d85b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.253 7f8c1d85b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Generic Connection:Keystone[] connection down >>, ] >> 03/20/2025 01:57:06.253 7f8c1d85b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.258 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Starting consumer greenlet 03/20/2025 01:57:06.259 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Ensuring Consumer connection 03/20/2025 01:57:06.259 7f8c1d351d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Starting publisher greenlet 03/20/2025 01:57:06.259 7f8c1d351d68 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Ensuring Publisher connection 03/20/2025 01:57:06.260 7f8c233eb2c8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Added consumer: amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy 03/20/2025 01:57:06.260 7f8c233eb2c8 [contrail-api] [DEBUG]: Add uve in the [none:ConfigApiWorkerTrace] map 03/20/2025 01:57:06.261 7f8c1f1a94e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.261 7f8c1f1a94e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ConfigApiWorkerTrace: data = << name = worker-0 worker_id = 0 introspect_port = 8084 admin_port = 8095 introspect_url = http://10.0.0.42:8084 >> 03/20/2025 01:57:06.261 7f8c1f1a94e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.268 7f8c1d351c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 03/20/2025 01:57:06.270 7f8c1d351d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Publisher connection established 03/20/2025 01:57:06.317 7f8c22f8bb70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: zk_sync_node data (nightly) 03/20/2025 01:57:06.321 7f8c22f8bb70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DBERESYNC: running walk 03/20/2025 01:57:06.374 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy'] 03/20/2025 01:57:06.388 7f8c22f8bb70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Cassandra DB walk completed. 03/20/2025 01:57:06.423 7f8c22f8bb70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Time elapsed in resyncing db: 0:00:00.366543 03/20/2025 01:57:06.424 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-a2100d72-989b-4e8d-bac7-9588262236d0', 'type': 'application_policy_set', 'uuid': 'f045dcda-023e-429a-9f40-7ce2fc20afdb'} 03/20/2025 01:57:06.433 7f8c1d828198 [contrail-api] [DEBUG]: Add uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 03/20/2025 01:57:06.433 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-76ceca32-68a7-4e9e-9e3a-32160a4cbf5c', 'type': 'network_ipam', 'uuid': 'f66b4c09-0c4c-42ef-ade0-dbf25202f4b2'} 03/20/2025 01:57:06.435 7f8c1b3c0c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.435 7f8c1b3c0c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]global_vrouter_config_refs : [{"to": ["default-global-system-config", "default-global-vrouter-config"], "attr": null, "uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7"}]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 17313487171394355866, "uuid_lslong": 11475309164874477531}, "enable": true, "created": "2025-03-20T00:46:09.353132", "last_modified": "2025-03-20T01:57:05.807779", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"parent_uuid : "c9f81784-63bb-4ab4-a557-daeb82ed1a4f"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "f045dcda-023e-429a-9f40-7ce2fc20afdb" } deleted = False >> 03/20/2025 01:57:06.435 7f8c1b3c0c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.441 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-b1e6a14f-56e2-4dd3-bad5-b95840575bac', 'type': 'project', 'uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33'} 03/20/2025 01:57:06.453 7f8c1d828198 [contrail-api] [DEBUG]: Add uve in the [ObjectProjectTable:ContrailConfigTrace] map 03/20/2025 01:57:06.454 7f8c20655198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.454 7f8c20655198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 14339520150639034695, "uuid_lslong": 11157562497880332851}, "enable": true, "created": "2025-03-20T00:46:09.111489", "last_modified": "2025-03-20T01:57:06.407525", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "78cb90fb-efc3-49d9-aab8-3061c7ab1bd1"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}quota : {"defaults": -1}uuid : "c700359a-5c65-4147-9ad7-9ff9fd609a33" } deleted = False >> 03/20/2025 01:57:06.455 7f8c20655198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.457 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-41853f70-caea-4162-b65c-ac1e07522a5b', 'type': 'project', 'uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33'} 03/20/2025 01:57:06.466 7f8c1d828b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.466 7f8c1d828b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 14339520150639034695, "uuid_lslong": 11157562497880332851}, "enable": true, "created": "2025-03-20T00:46:09.111489", "last_modified": "2025-03-20T01:57:06.407525", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "78cb90fb-efc3-49d9-aab8-3061c7ab1bd1"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}quota : {"defaults": -1}uuid : "c700359a-5c65-4147-9ad7-9ff9fd609a33" } deleted = False >> 03/20/2025 01:57:06.466 7f8c1d828b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.475 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Ensuring Consumer connection 03/20/2025 01:57:06.491 7f8c1d351c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 03/20/2025 01:57:06.621 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy'] 03/20/2025 01:57:07.221 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-d7816ff3-8b64-478a-b163-9bb2e3cc96b0', 'type': 'application_policy_set', 'uuid': 'f045dcda-023e-429a-9f40-7ce2fc20afdb'} 03/20/2025 01:57:07.229 7f8c1d76d438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:07.229 7f8c1d76d438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]global_vrouter_config_refs : [{"to": ["default-global-system-config", "default-global-vrouter-config"], "attr": null, "uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7"}]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 17313487171394355866, "uuid_lslong": 11475309164874477531}, "enable": true, "created": "2025-03-20T00:46:09.353132", "last_modified": "2025-03-20T01:57:07.201632", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"parent_uuid : "c9f81784-63bb-4ab4-a557-daeb82ed1a4f"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "f045dcda-023e-429a-9f40-7ce2fc20afdb" } deleted = False >> 03/20/2025 01:57:07.229 7f8c1d76d438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:07.623 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-4a8f91b7-a126-4d2f-abb3-f68998a2bba0', 'type': 'network_ipam', 'uuid': 'f66b4c09-0c4c-42ef-ade0-dbf25202f4b2'} 03/20/2025 01:57:07.632 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:07.833 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-c505cb35-8d8c-4da8-9e10-4e69c8680710', 'type': 'project', 'uuid': 'c700359a-5c65-4147-9ad7-9ff9fd609a33'} 03/20/2025 01:57:07.840 7f8c1d1c3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:07.840 7f8c1d1c3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 14339520150639034695, "uuid_lslong": 11157562497880332851}, "enable": true, "created": "2025-03-20T00:46:09.111489", "last_modified": "2025-03-20T01:57:07.821315", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "78cb90fb-efc3-49d9-aab8-3061c7ab1bd1"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}quota : {"defaults": -1}uuid : "c700359a-5c65-4147-9ad7-9ff9fd609a33" } deleted = False >> 03/20/2025 01:57:07.840 7f8c1d1c3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:08.634 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:09.129 7f8c1d1c3ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:09.131 7f8c1d1c3ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:09.131 7f8c1d1c3ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:09.131 7f8c1d1c3ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:09.131 7f8c1d1c3ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Generic Connection:Keystone[] connection down >>, ] >> 03/20/2025 01:57:09.131 7f8c1d1c3ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:09.131 7f8c1d1c3ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:09.132 7f8c1d1c3ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:09.132 7f8c1d1c3ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:09.132 7f8c1d1c3ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Generic Connection:Keystone[] connection down >>, ] >> 03/20/2025 01:57:09.132 7f8c1d1c3ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:09.132 7f8c1d1c3ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:09.132 7f8c1d1c3ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742435825128799 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 01:57:09.132 7f8c1d1c3ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:09.635 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:10.636 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:11.139 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 01:57:11.140 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 01:57:11.140 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 01:57:11.140 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 01:57:11.140 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 01:57:11.140 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 01:57:11.140 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 01:57:11.140 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 01:57:11.140 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 01:57:11.140 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 01:57:11.140 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 01:57:11.140 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 01:57:11.140 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 01:57:11.140 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 01:57:11.140 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 01:57:11.141 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 01:57:11.141 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 01:57:11.141 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 01:57:11.141 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 01:57:11.141 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 01:57:11.141 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 01:57:11.141 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 01:57:11.141 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 01:57:11.141 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 01:57:11.141 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 01:57:11.141 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 01:57:11.141 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 01:57:11.141 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 01:57:11.141 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 01:57:11.142 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 01:57:11.142 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 01:57:11.142 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 01:57:11.142 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 01:57:11.142 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 01:57:11.200 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 01:57:11.201 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 01:57:11.201 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 01:57:11.201 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 01:57:11.201 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 01:57:11.201 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 01:57:11.201 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 01:57:11.201 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 01:57:11.201 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 01:57:11.201 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 01:57:11.201 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 01:57:11.201 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 01:57:11.201 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 01:57:11.202 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 01:57:11.202 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 01:57:11.202 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 01:57:11.202 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 01:57:11.202 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 01:57:11.202 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 01:57:11.202 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 01:57:11.202 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 01:57:11.202 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 01:57:11.203 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 01:57:11.203 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 01:57:11.203 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 01:57:11.203 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 01:57:11.203 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 01:57:11.203 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 01:57:11.203 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 01:57:11.203 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 01:57:11.203 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 01:57:11.203 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 01:57:11.203 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 01:57:11.203 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 01:57:11.212 7f8c1d828b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource config-node: 'tag_refs' 03/20/2025 01:57:11.326 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource config-node: 'tag_refs' 03/20/2025 01:57:11.642 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:12.065 7f8c1f007390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_DNS_refs in resource network-ipam: 'virtual_DNS_refs' 03/20/2025 01:57:12.065 7f8c1f007390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource network-ipam: 'tag_refs' 03/20/2025 01:57:12.065 7f8c1f007390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_network_back_refs in resource network-ipam: 'virtual_network_back_refs' 03/20/2025 01:57:12.066 7f8c1f007390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_router_back_refs in resource network-ipam: 'virtual_router_back_refs' 03/20/2025 01:57:12.066 7f8c1f007390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource network-ipam: 'instance_ip_back_refs' 03/20/2025 01:57:12.643 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:12.925 7f8c1d25a630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:12.925 7f8c1d25a630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:12.925 7f8c1d25a630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:13.131 7f8c1d25a630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:13.132 7f8c1d25a630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:13.132 7f8c1d25a630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:13.132 7f8c1d25a630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:13.133 7f8c1d25a630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:13.133 7f8c1d25a630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:13.133 7f8c1d25a630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:13.133 7f8c1d25a630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:13.133 7f8c1d25a630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:13.133 7f8c1d25a630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:13.133 7f8c1d25a630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:13.133 7f8c1d25a630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:13.133 7f8c1d25a630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742435825128799 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 01:57:13.133 7f8c1d25a630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:13.247 7f8c1d25b198 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = df83a9c3-866e-4ef4-8457-9d8f1ab72fe8 object_type = access_control_list identifier_name = default-domain:default-project:ip-fabric:ip-fabric url = http://10.0.0.42:8082/access-control-list/df83a9c3-866e-4ef4-8457-9d8f1ab72fe8 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/usr/local/bin/contrail-schema remote_ip = 10.0.0.47 body = {"access-control-list": {"uuid": "df83a9c3-866e-4ef4-8457-9d8f1ab72fe8", "access_control_list_entries": {"dynamic": false, "acl_rule": [{"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "deny", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000002", "direction": "<>"}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}]}, "access_control_list_hash": -6384842183383480238}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:13.261 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-bd640a9b-21ff-4464-b80f-0e8826336b29', 'type': 'access_control_list', 'uuid': 'df83a9c3-866e-4ef4-8457-9d8f1ab72fe8'} 03/20/2025 01:57:13.644 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:14.646 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:15.648 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:16.650 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:17.134 7f8c1d24e828 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:17.135 7f8c1d24e828 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:17.135 7f8c1d24e828 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:17.135 7f8c1d24e828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:17.135 7f8c1d24e828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:17.135 7f8c1d24e828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:17.136 7f8c1d24e828 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:17.136 7f8c1d24e828 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:17.136 7f8c1d24e828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:17.136 7f8c1d24e828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:17.136 7f8c1d24e828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:17.136 7f8c1d24e828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:17.136 7f8c1d24e828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742435825128799 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 01:57:17.136 7f8c1d24e828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:17.651 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:18.597 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_objects in resource global-vrouter-config: 'security_logging_objects' 03/20/2025 01:57:18.597 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-vrouter-config: 'tag_refs' 03/20/2025 01:57:18.597 7f8c1d7366d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field application_policy_set_back_refs in resource global-vrouter-config: 'application_policy_set_back_refs' 03/20/2025 01:57:18.614 7f8c1d0b44e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_objects in resource global-vrouter-config: 'security_logging_objects' 03/20/2025 01:57:18.614 7f8c1d0b44e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-vrouter-config: 'tag_refs' 03/20/2025 01:57:18.614 7f8c1d0b44e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field application_policy_set_back_refs in resource global-vrouter-config: 'application_policy_set_back_refs' 03/20/2025 01:57:18.638 7f8c1d0b0240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_objects in resource global-vrouter-config: 'security_logging_objects' 03/20/2025 01:57:18.639 7f8c1d0b0240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-vrouter-config: 'tag_refs' 03/20/2025 01:57:18.639 7f8c1d0b0240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field application_policy_set_back_refs in resource global-vrouter-config: 'application_policy_set_back_refs' 03/20/2025 01:57:18.653 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:18.700 7f8c1d7366d8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.47 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["10.0.0.42"]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:18.714 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-829dc700-973d-470b-8429-63e022766464', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:57:18.738 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.12 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["10.0.0.42"]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:18.742 7f8c1d0b0240 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.42 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["10.0.0.42"]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:18.759 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-5d7fcd80-8f3f-48f3-a114-64a087335424', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:57:18.774 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-b7e1928d-f68a-4c71-9564-aca4d88bb09b', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:57:19.656 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:20.325 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3688031d-5203-42b0-ac58-7dcd46cf5ea1 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.42:8082/alarm/3688031d-5203-42b0-ac58-7dcd46cf5ea1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "3688031d-5203-42b0-ac58-7dcd46cf5ea1", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:20.349 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-bb5d24c0-f809-49e5-9a0f-a5d0dd1e1ea6', 'type': 'alarm', 'uuid': '3688031d-5203-42b0-ac58-7dcd46cf5ea1'} 03/20/2025 01:57:20.361 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3688031d-5203-42b0-ac58-7dcd46cf5ea1 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.42:8082/alarm/3688031d-5203-42b0-ac58-7dcd46cf5ea1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "3688031d-5203-42b0-ac58-7dcd46cf5ea1", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:20.391 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3688031d-5203-42b0-ac58-7dcd46cf5ea1 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.42:8082/alarm/3688031d-5203-42b0-ac58-7dcd46cf5ea1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "3688031d-5203-42b0-ac58-7dcd46cf5ea1", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:20.399 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-847c255d-b233-4462-977c-168be5fe1f41', 'type': 'alarm', 'uuid': '3688031d-5203-42b0-ac58-7dcd46cf5ea1'} 03/20/2025 01:57:20.423 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-04b08bc1-c145-47ef-acd7-33dd6e1ff460', 'type': 'alarm', 'uuid': '3688031d-5203-42b0-ac58-7dcd46cf5ea1'} 03/20/2025 01:57:20.501 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 56f4320b-26d1-451b-9fe7-f4ff57616681 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.42:8082/alarm/56f4320b-26d1-451b-9fe7-f4ff57616681 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "56f4320b-26d1-451b-9fe7-f4ff57616681", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:20.535 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-411c4161-3686-4058-b396-656450eeb9cf', 'type': 'alarm', 'uuid': '56f4320b-26d1-451b-9fe7-f4ff57616681'} 03/20/2025 01:57:20.557 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 56f4320b-26d1-451b-9fe7-f4ff57616681 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.42:8082/alarm/56f4320b-26d1-451b-9fe7-f4ff57616681 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "56f4320b-26d1-451b-9fe7-f4ff57616681", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:20.567 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 56f4320b-26d1-451b-9fe7-f4ff57616681 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.42:8082/alarm/56f4320b-26d1-451b-9fe7-f4ff57616681 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "56f4320b-26d1-451b-9fe7-f4ff57616681", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:20.596 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-e23cb181-df65-4a90-9c43-450a1f31df13', 'type': 'alarm', 'uuid': '56f4320b-26d1-451b-9fe7-f4ff57616681'} 03/20/2025 01:57:20.614 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-732da5d7-f532-4906-b438-2d61989f46b0', 'type': 'alarm', 'uuid': '56f4320b-26d1-451b-9fe7-f4ff57616681'} 03/20/2025 01:57:20.658 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:20.714 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fafc8875-3dfc-4334-895a-c8c457986dde object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.42:8082/alarm/fafc8875-3dfc-4334-895a-c8c457986dde operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "fafc8875-3dfc-4334-895a-c8c457986dde", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:20.738 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-6a33cdd7-2c45-43ca-9bce-e9c80f9f8e1b', 'type': 'alarm', 'uuid': 'fafc8875-3dfc-4334-895a-c8c457986dde'} 03/20/2025 01:57:20.766 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fafc8875-3dfc-4334-895a-c8c457986dde object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.42:8082/alarm/fafc8875-3dfc-4334-895a-c8c457986dde operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "fafc8875-3dfc-4334-895a-c8c457986dde", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:20.767 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fafc8875-3dfc-4334-895a-c8c457986dde object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.42:8082/alarm/fafc8875-3dfc-4334-895a-c8c457986dde operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "fafc8875-3dfc-4334-895a-c8c457986dde", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:20.802 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-08fdd918-bb00-4f1b-b971-992e0bf9e516', 'type': 'alarm', 'uuid': 'fafc8875-3dfc-4334-895a-c8c457986dde'} 03/20/2025 01:57:20.813 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-40409583-9888-40c7-aa42-604d71c827f4', 'type': 'alarm', 'uuid': 'fafc8875-3dfc-4334-895a-c8c457986dde'} 03/20/2025 01:57:20.895 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e0a70522-a423-418b-ab13-133cdcba20fa object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.42:8082/alarm/e0a70522-a423-418b-ab13-133cdcba20fa operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "e0a70522-a423-418b-ab13-133cdcba20fa", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:20.917 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-201b4e0b-9a7f-4034-bc09-22590d79a164', 'type': 'alarm', 'uuid': 'e0a70522-a423-418b-ab13-133cdcba20fa'} 03/20/2025 01:57:20.956 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e0a70522-a423-418b-ab13-133cdcba20fa object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.42:8082/alarm/e0a70522-a423-418b-ab13-133cdcba20fa operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "e0a70522-a423-418b-ab13-133cdcba20fa", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:20.958 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e0a70522-a423-418b-ab13-133cdcba20fa object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.42:8082/alarm/e0a70522-a423-418b-ab13-133cdcba20fa operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "e0a70522-a423-418b-ab13-133cdcba20fa", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:20.979 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-cff478cf-757f-480f-8678-82f3dac411ef', 'type': 'alarm', 'uuid': 'e0a70522-a423-418b-ab13-133cdcba20fa'} 03/20/2025 01:57:20.989 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-ee6d43fc-dd8c-4df4-885c-692f06414c50', 'type': 'alarm', 'uuid': 'e0a70522-a423-418b-ab13-133cdcba20fa'} 03/20/2025 01:57:21.069 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.42:8082/alarm/b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.092 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-376c4a97-1264-44d2-a6f7-0ecd4dbd35cd', 'type': 'alarm', 'uuid': 'b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d'} 03/20/2025 01:57:21.136 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.42:8082/alarm/b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.137 7f8c1d06b6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:21.140 7f8c1d06b6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:21.141 7f8c1d06b6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:21.141 7f8c1d06b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:21.147 7f8c1d06b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:21.147 7f8c1d06b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:21.147 7f8c1d06b6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:21.147 7f8c1d06b6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:21.147 7f8c1d06b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:21.147 7f8c1d06b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:21.148 7f8c1d06b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:21.148 7f8c1d06b6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:21.148 7f8c1d06b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742435825128799 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 01:57:21.148 7f8c1d06b6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:21.149 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.42:8082/alarm/b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.167 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-4e8571ca-b1e2-46ef-b6dc-9733c1a4fe9d', 'type': 'alarm', 'uuid': 'b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d'} 03/20/2025 01:57:21.177 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-9b7f6f6f-1927-4941-acdf-9941be478624', 'type': 'alarm', 'uuid': 'b12e87b7-15a0-4eba-b9b5-e6a35bf6e11d'} 03/20/2025 01:57:21.252 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8f2b5ec4-29e4-4bfe-afdf-830264fdfbae object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.42:8082/alarm/8f2b5ec4-29e4-4bfe-afdf-830264fdfbae operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "8f2b5ec4-29e4-4bfe-afdf-830264fdfbae", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.293 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-7b84aa95-cd3b-4329-a001-7357cd135eb9', 'type': 'alarm', 'uuid': '8f2b5ec4-29e4-4bfe-afdf-830264fdfbae'} 03/20/2025 01:57:21.335 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8f2b5ec4-29e4-4bfe-afdf-830264fdfbae object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.42:8082/alarm/8f2b5ec4-29e4-4bfe-afdf-830264fdfbae operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "8f2b5ec4-29e4-4bfe-afdf-830264fdfbae", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.339 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8f2b5ec4-29e4-4bfe-afdf-830264fdfbae object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.42:8082/alarm/8f2b5ec4-29e4-4bfe-afdf-830264fdfbae operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "8f2b5ec4-29e4-4bfe-afdf-830264fdfbae", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.369 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-bd2c8e75-b59a-4d36-95f4-3869cc3aac85', 'type': 'alarm', 'uuid': '8f2b5ec4-29e4-4bfe-afdf-830264fdfbae'} 03/20/2025 01:57:21.384 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-9c2955ff-ea44-43c9-9f1d-5978888ead3a', 'type': 'alarm', 'uuid': '8f2b5ec4-29e4-4bfe-afdf-830264fdfbae'} 03/20/2025 01:57:21.462 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.42:8082/alarm/ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.505 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-8dcb2031-0130-49d1-898b-58db841141a4', 'type': 'alarm', 'uuid': 'ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc'} 03/20/2025 01:57:21.531 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.42:8082/alarm/ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.535 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.42:8082/alarm/ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.570 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-df7b2355-a25a-40e5-94e5-7afa0cddaadc', 'type': 'alarm', 'uuid': 'ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc'} 03/20/2025 01:57:21.574 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-68928ae9-7bb2-4313-8a2d-6a3eef3254f0', 'type': 'alarm', 'uuid': 'ed95b6f6-c2a8-48a1-add0-e9f01ca0f2dc'} 03/20/2025 01:57:21.659 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 77e5a4aa-a58c-424e-af48-5fdc106a8324 object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.42:8082/alarm/77e5a4aa-a58c-424e-af48-5fdc106a8324 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "77e5a4aa-a58c-424e-af48-5fdc106a8324", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.659 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:21.685 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-e3edab83-c4d4-4550-a2c6-8fa6ed508f03', 'type': 'alarm', 'uuid': '77e5a4aa-a58c-424e-af48-5fdc106a8324'} 03/20/2025 01:57:21.717 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 77e5a4aa-a58c-424e-af48-5fdc106a8324 object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.42:8082/alarm/77e5a4aa-a58c-424e-af48-5fdc106a8324 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "77e5a4aa-a58c-424e-af48-5fdc106a8324", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.724 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 77e5a4aa-a58c-424e-af48-5fdc106a8324 object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.42:8082/alarm/77e5a4aa-a58c-424e-af48-5fdc106a8324 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "77e5a4aa-a58c-424e-af48-5fdc106a8324", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.752 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-ffc964e1-8a40-4893-b67a-04d6bd3da39c', 'type': 'alarm', 'uuid': '77e5a4aa-a58c-424e-af48-5fdc106a8324'} 03/20/2025 01:57:21.758 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-2a8c5e5e-ea9d-489e-987e-be9f7cb6d5c5', 'type': 'alarm', 'uuid': '77e5a4aa-a58c-424e-af48-5fdc106a8324'} 03/20/2025 01:57:21.850 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 565e6907-65a2-4ad5-a8fa-385c54978fe9 object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.42:8082/alarm/565e6907-65a2-4ad5-a8fa-385c54978fe9 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "565e6907-65a2-4ad5-a8fa-385c54978fe9", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.895 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-802a289f-e34b-4b2d-9bda-ced7f3f3ba3f', 'type': 'alarm', 'uuid': '565e6907-65a2-4ad5-a8fa-385c54978fe9'} 03/20/2025 01:57:21.910 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 565e6907-65a2-4ad5-a8fa-385c54978fe9 object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.42:8082/alarm/565e6907-65a2-4ad5-a8fa-385c54978fe9 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "565e6907-65a2-4ad5-a8fa-385c54978fe9", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.921 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 565e6907-65a2-4ad5-a8fa-385c54978fe9 object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.42:8082/alarm/565e6907-65a2-4ad5-a8fa-385c54978fe9 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "565e6907-65a2-4ad5-a8fa-385c54978fe9", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:21.965 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-f80eab04-6586-4f37-b92b-ae2063b021af', 'type': 'alarm', 'uuid': '565e6907-65a2-4ad5-a8fa-385c54978fe9'} 03/20/2025 01:57:21.991 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-444aff66-88ad-47ec-beca-7ac52597d689', 'type': 'alarm', 'uuid': '565e6907-65a2-4ad5-a8fa-385c54978fe9'} 03/20/2025 01:57:22.053 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 98c54fa0-fd53-43d5-b886-d865a493de69 object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.42:8082/alarm/98c54fa0-fd53-43d5-b886-d865a493de69 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "98c54fa0-fd53-43d5-b886-d865a493de69", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.077 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-98bb623e-e78e-4b6b-a458-9b2d9aaa4952', 'type': 'alarm', 'uuid': '98c54fa0-fd53-43d5-b886-d865a493de69'} 03/20/2025 01:57:22.114 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 98c54fa0-fd53-43d5-b886-d865a493de69 object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.42:8082/alarm/98c54fa0-fd53-43d5-b886-d865a493de69 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "98c54fa0-fd53-43d5-b886-d865a493de69", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.139 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-aa94250d-7e15-4575-a7f7-ac20e84a9485', 'type': 'alarm', 'uuid': '98c54fa0-fd53-43d5-b886-d865a493de69'} 03/20/2025 01:57:22.164 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 98c54fa0-fd53-43d5-b886-d865a493de69 object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.42:8082/alarm/98c54fa0-fd53-43d5-b886-d865a493de69 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "98c54fa0-fd53-43d5-b886-d865a493de69", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.186 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-1117b410-0e15-4957-ade0-86a576976cd1', 'type': 'alarm', 'uuid': '98c54fa0-fd53-43d5-b886-d865a493de69'} 03/20/2025 01:57:22.224 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6a83ce53-3291-4f62-9530-dca7b7c04997 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.42:8082/alarm/6a83ce53-3291-4f62-9530-dca7b7c04997 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "6a83ce53-3291-4f62-9530-dca7b7c04997", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.262 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-baf0c178-ac4d-4fa9-875b-e83fb33458e3', 'type': 'alarm', 'uuid': '6a83ce53-3291-4f62-9530-dca7b7c04997'} 03/20/2025 01:57:22.307 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6a83ce53-3291-4f62-9530-dca7b7c04997 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.42:8082/alarm/6a83ce53-3291-4f62-9530-dca7b7c04997 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "6a83ce53-3291-4f62-9530-dca7b7c04997", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.332 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6a83ce53-3291-4f62-9530-dca7b7c04997 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.42:8082/alarm/6a83ce53-3291-4f62-9530-dca7b7c04997 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "6a83ce53-3291-4f62-9530-dca7b7c04997", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.337 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-ae9fb5f5-4848-4a62-95e4-27ce8c5c142a', 'type': 'alarm', 'uuid': '6a83ce53-3291-4f62-9530-dca7b7c04997'} 03/20/2025 01:57:22.371 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-9ad39512-62f1-4066-b05a-75aa1ae30cd4', 'type': 'alarm', 'uuid': '6a83ce53-3291-4f62-9530-dca7b7c04997'} 03/20/2025 01:57:22.411 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 16d3d6af-3722-4a3f-97d7-d7e7b36b0cac object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.42:8082/alarm/16d3d6af-3722-4a3f-97d7-d7e7b36b0cac operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "16d3d6af-3722-4a3f-97d7-d7e7b36b0cac", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.437 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-667a757e-3b00-4cb7-b8b8-33259ee14a73', 'type': 'alarm', 'uuid': '16d3d6af-3722-4a3f-97d7-d7e7b36b0cac'} 03/20/2025 01:57:22.503 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 16d3d6af-3722-4a3f-97d7-d7e7b36b0cac object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.42:8082/alarm/16d3d6af-3722-4a3f-97d7-d7e7b36b0cac operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "16d3d6af-3722-4a3f-97d7-d7e7b36b0cac", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.519 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 16d3d6af-3722-4a3f-97d7-d7e7b36b0cac object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.42:8082/alarm/16d3d6af-3722-4a3f-97d7-d7e7b36b0cac operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "16d3d6af-3722-4a3f-97d7-d7e7b36b0cac", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.526 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-b8535b10-77c3-48ce-8bca-fc29752bc6fb', 'type': 'alarm', 'uuid': '16d3d6af-3722-4a3f-97d7-d7e7b36b0cac'} 03/20/2025 01:57:22.560 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-5d210b31-8522-46c3-95bc-1c6d53b20f39', 'type': 'alarm', 'uuid': '16d3d6af-3722-4a3f-97d7-d7e7b36b0cac'} 03/20/2025 01:57:22.598 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e02b9891-9ca3-4a17-b822-56bf3af41a51 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.42:8082/alarm/e02b9891-9ca3-4a17-b822-56bf3af41a51 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "e02b9891-9ca3-4a17-b822-56bf3af41a51", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.660 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:22.684 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e02b9891-9ca3-4a17-b822-56bf3af41a51 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.42:8082/alarm/e02b9891-9ca3-4a17-b822-56bf3af41a51 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "e02b9891-9ca3-4a17-b822-56bf3af41a51", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.686 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-7d3e7130-e715-4a03-805a-c55e8b1f486a', 'type': 'alarm', 'uuid': 'e02b9891-9ca3-4a17-b822-56bf3af41a51'} 03/20/2025 01:57:22.718 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-580b4176-6039-44c5-9e79-63f6f94f719d', 'type': 'alarm', 'uuid': 'e02b9891-9ca3-4a17-b822-56bf3af41a51'} 03/20/2025 01:57:22.752 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e02b9891-9ca3-4a17-b822-56bf3af41a51 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.42:8082/alarm/e02b9891-9ca3-4a17-b822-56bf3af41a51 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "e02b9891-9ca3-4a17-b822-56bf3af41a51", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.770 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-d9535579-205e-4103-9ee0-530f9846ff40', 'type': 'alarm', 'uuid': 'e02b9891-9ca3-4a17-b822-56bf3af41a51'} 03/20/2025 01:57:22.841 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b9be1540-ad7f-404b-9f70-528ee5f036a5 object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.42:8082/alarm/b9be1540-ad7f-404b-9f70-528ee5f036a5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "b9be1540-ad7f-404b-9f70-528ee5f036a5", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.857 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-b766fbab-379f-415f-be61-71767dcd1a01', 'type': 'alarm', 'uuid': 'b9be1540-ad7f-404b-9f70-528ee5f036a5'} 03/20/2025 01:57:22.867 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b9be1540-ad7f-404b-9f70-528ee5f036a5 object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.42:8082/alarm/b9be1540-ad7f-404b-9f70-528ee5f036a5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "b9be1540-ad7f-404b-9f70-528ee5f036a5", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.882 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-6315d440-e7ff-46e5-9579-7c1a4851be10', 'type': 'alarm', 'uuid': 'b9be1540-ad7f-404b-9f70-528ee5f036a5'} 03/20/2025 01:57:22.920 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b9be1540-ad7f-404b-9f70-528ee5f036a5 object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.42:8082/alarm/b9be1540-ad7f-404b-9f70-528ee5f036a5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "b9be1540-ad7f-404b-9f70-528ee5f036a5", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:22.961 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-f19800c1-4d49-4df1-a412-c6412bf2ae8c', 'type': 'alarm', 'uuid': 'b9be1540-ad7f-404b-9f70-528ee5f036a5'} 03/20/2025 01:57:23.005 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f599f8b8-acce-4574-8066-8db660d03fe0 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.42:8082/alarm/f599f8b8-acce-4574-8066-8db660d03fe0 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "f599f8b8-acce-4574-8066-8db660d03fe0", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.023 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-9ede42c6-c3a2-421c-8c11-195b2e9ad907', 'type': 'alarm', 'uuid': 'f599f8b8-acce-4574-8066-8db660d03fe0'} 03/20/2025 01:57:23.031 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f599f8b8-acce-4574-8066-8db660d03fe0 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.42:8082/alarm/f599f8b8-acce-4574-8066-8db660d03fe0 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "f599f8b8-acce-4574-8066-8db660d03fe0", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.056 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-99fa867f-3d82-4fc7-b5a5-369f3c1be32c', 'type': 'alarm', 'uuid': 'f599f8b8-acce-4574-8066-8db660d03fe0'} 03/20/2025 01:57:23.129 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f599f8b8-acce-4574-8066-8db660d03fe0 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.42:8082/alarm/f599f8b8-acce-4574-8066-8db660d03fe0 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "f599f8b8-acce-4574-8066-8db660d03fe0", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.157 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-e974724b-eb8c-4929-91f9-d92814254223', 'type': 'alarm', 'uuid': 'f599f8b8-acce-4574-8066-8db660d03fe0'} 03/20/2025 01:57:23.182 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 08b1b6c6-a070-47bd-8038-453eb2ee0fc2 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.42:8082/alarm/08b1b6c6-a070-47bd-8038-453eb2ee0fc2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "08b1b6c6-a070-47bd-8038-453eb2ee0fc2", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.208 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-c16cfb1d-d269-4a01-9dda-fff281902fa3', 'type': 'alarm', 'uuid': '08b1b6c6-a070-47bd-8038-453eb2ee0fc2'} 03/20/2025 01:57:23.211 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 08b1b6c6-a070-47bd-8038-453eb2ee0fc2 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.42:8082/alarm/08b1b6c6-a070-47bd-8038-453eb2ee0fc2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "08b1b6c6-a070-47bd-8038-453eb2ee0fc2", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.229 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-10fce506-df4f-4e30-8708-5e6b2a76c3d3', 'type': 'alarm', 'uuid': '08b1b6c6-a070-47bd-8038-453eb2ee0fc2'} 03/20/2025 01:57:23.306 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 08b1b6c6-a070-47bd-8038-453eb2ee0fc2 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.42:8082/alarm/08b1b6c6-a070-47bd-8038-453eb2ee0fc2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "08b1b6c6-a070-47bd-8038-453eb2ee0fc2", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.333 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-3da13ed8-99d6-4e05-9177-b213d38bf254', 'type': 'alarm', 'uuid': '08b1b6c6-a070-47bd-8038-453eb2ee0fc2'} 03/20/2025 01:57:23.365 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4c365283-3f6b-4ce3-98fb-4d5564da3a54 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.42:8082/alarm/4c365283-3f6b-4ce3-98fb-4d5564da3a54 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "4c365283-3f6b-4ce3-98fb-4d5564da3a54", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.387 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4c365283-3f6b-4ce3-98fb-4d5564da3a54 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.42:8082/alarm/4c365283-3f6b-4ce3-98fb-4d5564da3a54 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "4c365283-3f6b-4ce3-98fb-4d5564da3a54", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.418 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-acebd10b-f10d-4b41-8cbb-d93cdf76bfa8', 'type': 'alarm', 'uuid': '4c365283-3f6b-4ce3-98fb-4d5564da3a54'} 03/20/2025 01:57:23.426 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-646c14c0-f46b-46a0-a39c-d0f663abfb13', 'type': 'alarm', 'uuid': '4c365283-3f6b-4ce3-98fb-4d5564da3a54'} 03/20/2025 01:57:23.512 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4c365283-3f6b-4ce3-98fb-4d5564da3a54 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.42:8082/alarm/4c365283-3f6b-4ce3-98fb-4d5564da3a54 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "4c365283-3f6b-4ce3-98fb-4d5564da3a54", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.544 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-55b88645-3ee5-4cb8-a422-5ee22f56babf', 'type': 'alarm', 'uuid': '4c365283-3f6b-4ce3-98fb-4d5564da3a54'} 03/20/2025 01:57:23.568 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ca5c7bd2-8580-4f61-9f45-597270fd3915 object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.42:8082/alarm/ca5c7bd2-8580-4f61-9f45-597270fd3915 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "ca5c7bd2-8580-4f61-9f45-597270fd3915", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.592 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ca5c7bd2-8580-4f61-9f45-597270fd3915 object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.42:8082/alarm/ca5c7bd2-8580-4f61-9f45-597270fd3915 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "ca5c7bd2-8580-4f61-9f45-597270fd3915", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.608 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-bf0143f6-75b4-49a8-9cec-7df2ee164dae', 'type': 'alarm', 'uuid': 'ca5c7bd2-8580-4f61-9f45-597270fd3915'} 03/20/2025 01:57:23.638 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-1d2e3fd9-af08-497e-b997-fcf9b261e47f', 'type': 'alarm', 'uuid': 'ca5c7bd2-8580-4f61-9f45-597270fd3915'} 03/20/2025 01:57:23.661 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:23.707 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ca5c7bd2-8580-4f61-9f45-597270fd3915 object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.42:8082/alarm/ca5c7bd2-8580-4f61-9f45-597270fd3915 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "ca5c7bd2-8580-4f61-9f45-597270fd3915", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.737 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-d76911f5-dc98-4ec3-933a-321357adbf00', 'type': 'alarm', 'uuid': 'ca5c7bd2-8580-4f61-9f45-597270fd3915'} 03/20/2025 01:57:23.772 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9fc2de9a-a509-4f4c-ba90-38e77eb05d73 object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.42:8082/alarm/9fc2de9a-a509-4f4c-ba90-38e77eb05d73 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "9fc2de9a-a509-4f4c-ba90-38e77eb05d73", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.800 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-4dd80ee1-b785-4a26-91a6-8dcbea29e110', 'type': 'alarm', 'uuid': '9fc2de9a-a509-4f4c-ba90-38e77eb05d73'} 03/20/2025 01:57:23.805 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9fc2de9a-a509-4f4c-ba90-38e77eb05d73 object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.42:8082/alarm/9fc2de9a-a509-4f4c-ba90-38e77eb05d73 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "9fc2de9a-a509-4f4c-ba90-38e77eb05d73", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.822 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-fdb4b508-9f49-4a2a-8fb7-f8378f2b235b', 'type': 'alarm', 'uuid': '9fc2de9a-a509-4f4c-ba90-38e77eb05d73'} 03/20/2025 01:57:23.887 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9fc2de9a-a509-4f4c-ba90-38e77eb05d73 object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.42:8082/alarm/9fc2de9a-a509-4f4c-ba90-38e77eb05d73 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "9fc2de9a-a509-4f4c-ba90-38e77eb05d73", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.908 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-650260d8-d124-47e2-852f-9d8486a49d08', 'type': 'alarm', 'uuid': '9fc2de9a-a509-4f4c-ba90-38e77eb05d73'} 03/20/2025 01:57:23.940 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8b6abc1c-bd01-4612-85ab-0a0e23cecc68 object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.42:8082/alarm/8b6abc1c-bd01-4612-85ab-0a0e23cecc68 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "8b6abc1c-bd01-4612-85ab-0a0e23cecc68", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.958 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-aec1687c-955c-4d3f-b2d4-87db5cb2e259', 'type': 'alarm', 'uuid': '8b6abc1c-bd01-4612-85ab-0a0e23cecc68'} 03/20/2025 01:57:23.972 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8b6abc1c-bd01-4612-85ab-0a0e23cecc68 object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.42:8082/alarm/8b6abc1c-bd01-4612-85ab-0a0e23cecc68 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "8b6abc1c-bd01-4612-85ab-0a0e23cecc68", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:23.991 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-0faba6ea-ac1e-4848-b4b2-cc86cc4dd44b', 'type': 'alarm', 'uuid': '8b6abc1c-bd01-4612-85ab-0a0e23cecc68'} 03/20/2025 01:57:24.059 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8b6abc1c-bd01-4612-85ab-0a0e23cecc68 object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.42:8082/alarm/8b6abc1c-bd01-4612-85ab-0a0e23cecc68 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "8b6abc1c-bd01-4612-85ab-0a0e23cecc68", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:24.086 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-3eca50d9-663a-4102-a79f-2d87315fec3d', 'type': 'alarm', 'uuid': '8b6abc1c-bd01-4612-85ab-0a0e23cecc68'} 03/20/2025 01:57:24.101 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = cc74187c-06a9-4d6b-8d8e-650afaf4a9e2 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.42:8082/alarm/cc74187c-06a9-4d6b-8d8e-650afaf4a9e2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "cc74187c-06a9-4d6b-8d8e-650afaf4a9e2", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:24.125 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-6a48e335-3be9-4936-ad46-6688ec973445', 'type': 'alarm', 'uuid': 'cc74187c-06a9-4d6b-8d8e-650afaf4a9e2'} 03/20/2025 01:57:24.148 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = cc74187c-06a9-4d6b-8d8e-650afaf4a9e2 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.42:8082/alarm/cc74187c-06a9-4d6b-8d8e-650afaf4a9e2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "cc74187c-06a9-4d6b-8d8e-650afaf4a9e2", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:24.166 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-88644b74-5c25-4c75-898b-4e05f76d78e9', 'type': 'alarm', 'uuid': 'cc74187c-06a9-4d6b-8d8e-650afaf4a9e2'} 03/20/2025 01:57:24.235 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = cc74187c-06a9-4d6b-8d8e-650afaf4a9e2 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.42:8082/alarm/cc74187c-06a9-4d6b-8d8e-650afaf4a9e2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "cc74187c-06a9-4d6b-8d8e-650afaf4a9e2", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:24.267 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-35c7062c-bdc3-4cf3-b8c6-6f8fb3c3111c', 'type': 'alarm', 'uuid': 'cc74187c-06a9-4d6b-8d8e-650afaf4a9e2'} 03/20/2025 01:57:24.280 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2c9b02ba-35bc-4d67-86d4-0e010edd049b object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.42:8082/alarm/2c9b02ba-35bc-4d67-86d4-0e010edd049b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "2c9b02ba-35bc-4d67-86d4-0e010edd049b", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:24.306 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2c9b02ba-35bc-4d67-86d4-0e010edd049b object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.42:8082/alarm/2c9b02ba-35bc-4d67-86d4-0e010edd049b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "2c9b02ba-35bc-4d67-86d4-0e010edd049b", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:24.336 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-22f7ed56-b553-45df-b6f8-fd75162e3a21', 'type': 'alarm', 'uuid': '2c9b02ba-35bc-4d67-86d4-0e010edd049b'} 03/20/2025 01:57:24.350 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-545e12a7-d847-495a-b914-510aa95fb015', 'type': 'alarm', 'uuid': '2c9b02ba-35bc-4d67-86d4-0e010edd049b'} 03/20/2025 01:57:24.423 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2c9b02ba-35bc-4d67-86d4-0e010edd049b object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.42:8082/alarm/2c9b02ba-35bc-4d67-86d4-0e010edd049b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "2c9b02ba-35bc-4d67-86d4-0e010edd049b", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:24.448 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-1b972e2b-af3d-466d-ad09-98a2739b7d19', 'type': 'alarm', 'uuid': '2c9b02ba-35bc-4d67-86d4-0e010edd049b'} 03/20/2025 01:57:24.481 7f8c1d0b44e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bcb5ab76-d8ec-4914-b025-04833530d175 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.42:8082/alarm/bcb5ab76-d8ec-4914-b025-04833530d175 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.47 body = {"alarm": {"uuid": "bcb5ab76-d8ec-4914-b025-04833530d175", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:24.488 7f8c1d022588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bcb5ab76-d8ec-4914-b025-04833530d175 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.42:8082/alarm/bcb5ab76-d8ec-4914-b025-04833530d175 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.42 body = {"alarm": {"uuid": "bcb5ab76-d8ec-4914-b025-04833530d175", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:24.506 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-47ef6ae4-ee78-4525-8e12-da500187c2e4', 'type': 'alarm', 'uuid': 'bcb5ab76-d8ec-4914-b025-04833530d175'} 03/20/2025 01:57:24.512 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-37bbc556-a1e2-48b2-8485-f652eca86a94', 'type': 'alarm', 'uuid': 'bcb5ab76-d8ec-4914-b025-04833530d175'} 03/20/2025 01:57:24.593 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bcb5ab76-d8ec-4914-b025-04833530d175 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.42:8082/alarm/bcb5ab76-d8ec-4914-b025-04833530d175 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "bcb5ab76-d8ec-4914-b025-04833530d175", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:24.612 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-9fa34460-05e1-4f76-823f-abd80e1b825c', 'type': 'alarm', 'uuid': 'bcb5ab76-d8ec-4914-b025-04833530d175'} 03/20/2025 01:57:24.662 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:25.141 7f8c1cedc240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:25.142 7f8c1cedc240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:25.142 7f8c1cedc240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:25.142 7f8c1cedc240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:25.142 7f8c1cedc240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:25.142 7f8c1cedc240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:25.142 7f8c1cedc240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:25.142 7f8c1cedc240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:25.142 7f8c1cedc240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:25.143 7f8c1cedc240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:25.143 7f8c1cedc240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:25.143 7f8c1cedc240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:25.143 7f8c1cedc240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742435825128799 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 01:57:25.143 7f8c1cedc240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:25.664 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:26.665 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:27.666 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:28.668 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:29.143 7f8c1cedc240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:29.144 7f8c1cedc240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:29.144 7f8c1cedc240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:29.144 7f8c1cedc240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:29.144 7f8c1cedc240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:29.144 7f8c1cedc240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:29.144 7f8c1cedc240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:29.145 7f8c1cedc240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:29.145 7f8c1cedc240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:29.145 7f8c1cedc240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:29.145 7f8c1cedc240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:29.145 7f8c1cedc240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:29.145 7f8c1cedc240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742435825128799 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 01:57:29.145 7f8c1cedc240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:29.669 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:30.670 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:31.672 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:32.673 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:33.145 7f8c1d026588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:33.146 7f8c1d026588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:33.146 7f8c1d026588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:33.146 7f8c1d026588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:33.146 7f8c1d026588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:33.146 7f8c1d026588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:33.147 7f8c1d026588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:33.147 7f8c1d026588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:33.147 7f8c1d026588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:33.147 7f8c1d026588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:33.147 7f8c1d026588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:33.147 7f8c1d026588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:33.147 7f8c1d026588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742435825128799 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 01:57:33.147 7f8c1d026588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:33.675 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:34.676 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:35.679 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:36.187 7f8c1cef8978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.42 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:36.206 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-89b8abd2-4780-4b76-8e0b-8c3116fc5d37', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:57:36.507 7f8c1d0268d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.47 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:36.523 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-b178570c-3c80-4fca-85a3-45e53b45930a', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:57:36.532 7f8c1cffbd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.12 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:36.549 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-c834baed-7069-49e0-9ae4-046018c94278', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:57:37.147 7f8c1ce13ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:37.148 7f8c1ce13ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:37.148 7f8c1ce13ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:37.148 7f8c1ce13ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:37.148 7f8c1ce13ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:37.149 7f8c1ce13ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:37.149 7f8c1ce13ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:37.149 7f8c1ce13ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:37.149 7f8c1ce13ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:37.149 7f8c1ce13ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:37.150 7f8c1ce13ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:37.150 7f8c1ce13ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:37.150 7f8c1ce13ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742435825128799 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 01:57:37.150 7f8c1ce13ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:37.493 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:38.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:39.495 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:40.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:41.149 7f8c1c1b4b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:41.151 7f8c1c1b4b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:41.152 7f8c1c1b4b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:41.152 7f8c1c1b4b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:41.152 7f8c1c1b4b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:41.152 7f8c1c1b4b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:41.152 7f8c1c1b4b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:41.153 7f8c1c1b4b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:41.153 7f8c1c1b4b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:41.153 7f8c1c1b4b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:41.153 7f8c1c1b4b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:41.153 7f8c1c1b4b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:41.153 7f8c1c1b4b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742435825128799 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 01:57:41.153 7f8c1c1b4b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:41.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:42.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:42.784 7f8c1d022ac8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_objects in resource global-vrouter-config: 'security_logging_objects' 03/20/2025 01:57:42.785 7f8c1d022ac8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-vrouter-config: 'tag_refs' 03/20/2025 01:57:42.785 7f8c1d022ac8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field application_policy_set_back_refs in resource global-vrouter-config: 'application_policy_set_back_refs' 03/20/2025 01:57:42.807 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_objects in resource global-vrouter-config: 'security_logging_objects' 03/20/2025 01:57:42.807 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-vrouter-config: 'tag_refs' 03/20/2025 01:57:42.807 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field application_policy_set_back_refs in resource global-vrouter-config: 'application_policy_set_back_refs' 03/20/2025 01:57:42.812 7f8c1ce0d8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_objects in resource global-vrouter-config: 'security_logging_objects' 03/20/2025 01:57:42.812 7f8c1ce0d8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-vrouter-config: 'tag_refs' 03/20/2025 01:57:42.812 7f8c1ce0d8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field application_policy_set_back_refs in resource global-vrouter-config: 'application_policy_set_back_refs' 03/20/2025 01:57:42.881 7f8c1d022ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.42 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:42.897 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-f5f18948-ae2b-471a-9145-1ab2fc4ba6ee', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:57:42.908 7f8c1ce11240 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.47 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:42.911 7f8c1ce0d8d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51066be0-09f9-43af-b4c7-ed3e68151dc7 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.42:8082/global-vrouter-config/51066be0-09f9-43af-b4c7-ed3e68151dc7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.12 body = {"global-vrouter-config": {"uuid": "51066be0-09f9-43af-b4c7-ed3e68151dc7", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:42.927 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-1dc38cb6-6934-4979-b842-20570b718a33', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:57:42.938 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-1d98276b-6475-4cc3-988b-b1e30cfea3f3', 'type': 'global_vrouter_config', 'uuid': '51066be0-09f9-43af-b4c7-ed3e68151dc7'} 03/20/2025 01:57:43.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:44.217 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 01:57:44.217 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 01:57:44.217 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 01:57:44.217 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 01:57:44.217 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 01:57:44.217 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 01:57:44.217 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 01:57:44.217 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 01:57:44.217 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 01:57:44.218 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 01:57:44.218 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 01:57:44.218 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 01:57:44.218 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 01:57:44.218 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 01:57:44.218 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 01:57:44.218 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 01:57:44.218 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 01:57:44.218 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 01:57:44.218 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 01:57:44.218 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 01:57:44.218 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 01:57:44.218 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 01:57:44.218 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 01:57:44.219 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 01:57:44.219 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 01:57:44.219 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 01:57:44.219 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 01:57:44.219 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 01:57:44.219 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 01:57:44.219 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 01:57:44.219 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 01:57:44.219 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 01:57:44.219 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 01:57:44.219 7f8c1ce11240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 01:57:44.231 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 01:57:44.232 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 01:57:44.232 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 01:57:44.232 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 01:57:44.233 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 01:57:44.233 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 01:57:44.233 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 01:57:44.233 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 01:57:44.233 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 01:57:44.233 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 01:57:44.233 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 01:57:44.233 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 01:57:44.233 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 01:57:44.234 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 01:57:44.234 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 01:57:44.234 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 01:57:44.234 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 01:57:44.234 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 01:57:44.234 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 01:57:44.234 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 01:57:44.234 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 01:57:44.234 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 01:57:44.234 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 01:57:44.234 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 01:57:44.234 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 01:57:44.234 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 01:57:44.234 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 01:57:44.235 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 01:57:44.235 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 01:57:44.235 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 01:57:44.235 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 01:57:44.235 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 01:57:44.235 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 01:57:44.235 7f8c1ce80588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 01:57:44.242 7f8c1ce80588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/global-system-config/92e769a6-5754-45f5-bd68-145125efbf0e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"global-system-config": {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:44.254 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 01:57:44.254 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 01:57:44.255 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 01:57:44.264 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 01:57:44.264 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 01:57:44.264 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 01:57:44.264 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 01:57:44.264 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 01:57:44.264 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 01:57:44.264 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 01:57:44.264 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 01:57:44.264 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 01:57:44.264 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 01:57:44.264 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 01:57:44.264 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 01:57:44.265 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 01:57:44.265 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 01:57:44.265 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 01:57:44.265 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 01:57:44.265 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 01:57:44.265 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 01:57:44.265 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 01:57:44.265 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 01:57:44.265 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 01:57:44.265 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 01:57:44.265 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 01:57:44.265 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 01:57:44.265 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 01:57:44.265 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 01:57:44.266 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 01:57:44.266 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 01:57:44.266 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 01:57:44.266 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 01:57:44.266 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 01:57:44.274 7f8c1ce11240 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/global-system-config/92e769a6-5754-45f5-bd68-145125efbf0e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.42 body = {"global-system-config": {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:44.284 7f8c1ceab588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 92e769a6-5754-45f5-bd68-145125efbf0e object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.42:8082/global-system-config/92e769a6-5754-45f5-bd68-145125efbf0e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"global-system-config": {"uuid": "92e769a6-5754-45f5-bd68-145125efbf0e", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 03/20/2025 01:57:44.306 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-5cdbd3ce-9755-4bec-8206-2f5d8cc6a8b5', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 01:57:44.328 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-92fe90cf-e7a5-4ed1-a9db-9d24ac9c56af', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 01:57:44.348 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-e65a6795-fdb1-409d-9a0e-f6d8d866ad37', 'type': 'global_system_config', 'uuid': '92e769a6-5754-45f5-bd68-145125efbf0e'} 03/20/2025 01:57:44.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:45.153 7f8c1ceab588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:45.154 7f8c1ceab588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:45.154 7f8c1ceab588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:45.154 7f8c1ceab588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:45.154 7f8c1ceab588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:45.154 7f8c1ceab588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:45.154 7f8c1ceab588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:45.155 7f8c1ceab588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:45.155 7f8c1ceab588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:45.155 7f8c1ceab588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:45.155 7f8c1ceab588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:45.155 7f8c1ceab588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:45.155 7f8c1ceab588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1742435825128799 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 01:57:45.155 7f8c1ceab588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:45.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:46.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:46.977 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 01:57:46.977 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 01:57:46.977 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 01:57:46.977 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 01:57:46.977 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 01:57:46.977 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 01:57:46.977 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 01:57:46.977 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 01:57:46.977 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 01:57:46.977 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 01:57:46.977 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 01:57:46.977 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 01:57:46.978 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 01:57:46.978 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 01:57:46.978 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 01:57:46.978 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 01:57:46.978 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 01:57:46.978 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 01:57:46.978 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 01:57:46.978 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 01:57:46.978 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 01:57:46.978 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 01:57:46.979 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 01:57:46.979 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 01:57:46.979 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 01:57:46.979 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 01:57:46.979 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 01:57:46.979 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 01:57:46.979 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 01:57:46.979 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 01:57:46.979 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 01:57:46.979 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 01:57:46.979 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 01:57:46.979 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 01:57:47.083 7f8c1ceab588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource analytics-node: 'tag_refs' 03/20/2025 01:57:47.308 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 01:57:47.308 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 01:57:47.309 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 01:57:47.309 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 01:57:47.309 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 01:57:47.309 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 01:57:47.309 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 01:57:47.309 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 01:57:47.309 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 01:57:47.310 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 01:57:47.310 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 01:57:47.310 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 01:57:47.310 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 01:57:47.310 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 01:57:47.310 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 01:57:47.310 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 01:57:47.310 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 01:57:47.310 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 01:57:47.310 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 01:57:47.310 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 01:57:47.310 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 01:57:47.310 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 01:57:47.310 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 01:57:47.311 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 01:57:47.311 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 01:57:47.311 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 01:57:47.311 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 01:57:47.311 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 01:57:47.311 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 01:57:47.311 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 01:57:47.311 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 01:57:47.311 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 01:57:47.311 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 01:57:47.311 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 01:57:47.369 7f8c1d257a20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource analytics-node: 'tag_refs' 03/20/2025 01:57:47.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:47.782 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 01:57:47.782 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 01:57:47.783 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 01:57:47.783 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 01:57:47.783 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 01:57:47.783 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 01:57:47.783 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 01:57:47.783 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 01:57:47.783 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 01:57:47.783 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 01:57:47.783 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 01:57:47.783 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 01:57:47.783 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 01:57:47.783 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 01:57:47.783 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 01:57:47.784 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 01:57:47.784 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 01:57:47.784 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 01:57:47.784 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 01:57:47.784 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 01:57:47.784 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 01:57:47.784 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 01:57:47.784 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 01:57:47.784 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 01:57:47.784 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 01:57:47.785 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 01:57:47.785 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 01:57:47.785 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 01:57:47.785 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 01:57:47.785 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 01:57:47.785 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 01:57:47.785 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 01:57:47.785 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 01:57:47.785 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 01:57:47.856 7f8c1d035048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource analytics-node: 'tag_refs' 03/20/2025 01:57:48.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:49.155 7f8c1d1bf8d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:49.156 7f8c1d1bf8d0 [contrail-api] [INFO]: Session Event: TCP Connected 03/20/2025 01:57:49.156 7f8c1d1bf8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:49.156 7f8c1d1bf8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:49.156 7f8c1d1bf8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.12:9041, 10.0.0.47:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.42:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:49.156 7f8c1d1bf8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:49.156 7f8c1d1bf8d0 [contrail-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:57:49.156 7f8c1d1bf8d0 [contrail-api] [DEBUG]: Send sandesh control message. uve type count # 19 03/20/2025 01:57:49.157 7f8c1d1bf8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:57:49.157 7f8c1d1bf8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:57:49.157 7f8c1d1bf8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:57:49.157 7f8c1d2664e0 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:57:49.158 7f8c1d2664e0 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:57:49.160 7f8c1d0ac390 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001017 03/20/2025 01:57:49.160 7f8c1d0ac390 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 01:57:49.161 7f8c1d263978 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 01:57:49.161 7f8c1d263978 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 01:57:49.161 7f8c1d263978 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 03/20/2025 01:57:49.161 7f8c1d263978 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 01:57:49.161 7f8c1d263978 [contrail-api] [DEBUG]: send sync_uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 03/20/2025 01:57:49.161 7f8c1d263978 [contrail-api] [DEBUG]: send sync_uve in the [ObjectProjectTable:ContrailConfigTrace] map 03/20/2025 01:57:49.161 7f8c1d263978 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:57:49.162 7f8c1d263978 [contrail-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 01:57:49.162 7f8c1e31a4e0 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:57:49.164 7f8c1e31a4e0 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:57:49.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:50.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:51.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:52.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:53.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:54.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:55.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:56.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:57.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:57.940 7f8c1d0ac390 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001575 03/20/2025 01:57:57.941 7f8c1d0ac390 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 01:57:57.941 7f8c1f545b70 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 03/20/2025 01:57:57.941 7f8c1f545b70 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 4 03/20/2025 01:57:57.941 7f8c1f545b70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 03/20/2025 01:57:57.941 7f8c1f545b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 01:57:57.941 7f8c1f545b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 03/20/2025 01:57:57.944 7f8c1f545b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectProjectTable:ContrailConfigTrace] map 03/20/2025 01:57:57.944 7f8c1f545b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:57:57.944 7f8c1d057c18 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:57:57.945 7f8c1d057c18 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:57:58.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:57:59.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:00.533 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:01.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:02.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:03.536 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:04.537 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:05.538 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:07.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:08.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:09.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:10.464 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 01:58:10.464 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 01:58:10.464 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 01:58:10.464 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 01:58:10.464 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 01:58:10.464 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 01:58:10.464 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 01:58:10.464 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 01:58:10.464 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 01:58:10.465 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 01:58:10.465 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 01:58:10.465 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 01:58:10.465 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 01:58:10.465 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 01:58:10.465 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 01:58:10.465 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 01:58:10.465 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 01:58:10.465 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 01:58:10.465 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 01:58:10.465 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 01:58:10.465 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 01:58:10.465 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 01:58:10.465 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 01:58:10.466 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 01:58:10.466 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 01:58:10.466 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 01:58:10.466 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 01:58:10.466 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 01:58:10.466 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 01:58:10.466 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 01:58:10.466 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 01:58:10.466 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 01:58:10.466 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 01:58:10.466 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 01:58:10.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:10.523 7f8c1e31a4e0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource analytics-alarm-node: 'tag_refs' 03/20/2025 01:58:10.877 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 01:58:10.878 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 01:58:10.878 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 01:58:10.878 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 01:58:10.878 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 01:58:10.878 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 01:58:10.878 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 01:58:10.878 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 01:58:10.878 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 01:58:10.878 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 01:58:10.878 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 01:58:10.878 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 01:58:10.878 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 01:58:10.879 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 01:58:10.880 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 01:58:10.880 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 01:58:10.880 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 01:58:10.880 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 01:58:10.880 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 01:58:10.880 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 01:58:10.939 7f8c1ce962e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource analytics-alarm-node: 'tag_refs' 03/20/2025 01:58:11.225 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 01:58:11.225 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 01:58:11.225 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 01:58:11.225 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 01:58:11.225 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 01:58:11.226 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 01:58:11.226 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 01:58:11.226 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 01:58:11.226 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 01:58:11.226 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 01:58:11.226 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 01:58:11.226 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 01:58:11.226 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 01:58:11.226 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 01:58:11.226 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 01:58:11.226 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 01:58:11.226 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 01:58:11.226 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 01:58:11.226 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 01:58:11.227 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 01:58:11.327 7f8c1cf4a630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource analytics-alarm-node: 'tag_refs' 03/20/2025 01:58:11.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:12.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:13.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:14.120 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 01:58:14.120 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 01:58:14.121 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 01:58:14.121 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 01:58:14.121 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 01:58:14.121 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 01:58:14.121 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 01:58:14.121 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 01:58:14.121 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 01:58:14.121 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 01:58:14.121 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 01:58:14.122 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 01:58:14.122 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 01:58:14.122 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 01:58:14.122 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 01:58:14.122 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 01:58:14.122 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 01:58:14.122 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 01:58:14.122 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 01:58:14.122 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 01:58:14.123 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 01:58:14.123 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 01:58:14.123 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 01:58:14.123 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 01:58:14.123 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 01:58:14.123 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 01:58:14.123 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 01:58:14.123 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 01:58:14.123 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 01:58:14.124 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 01:58:14.124 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 01:58:14.124 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 01:58:14.124 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 01:58:14.124 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 01:58:14.194 7f8c1f545b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource analytics-snmp-node: 'tag_refs' 03/20/2025 01:58:14.491 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 01:58:14.491 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 01:58:14.491 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 01:58:14.491 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 01:58:14.491 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 01:58:14.491 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 01:58:14.491 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 01:58:14.492 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 01:58:14.492 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 01:58:14.492 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 01:58:14.492 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 01:58:14.492 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 01:58:14.492 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 01:58:14.493 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 01:58:14.493 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 01:58:14.493 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 01:58:14.493 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 01:58:14.493 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 01:58:14.493 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 01:58:14.493 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 01:58:14.493 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 01:58:14.493 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 01:58:14.494 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 01:58:14.494 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 01:58:14.494 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 01:58:14.494 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 01:58:14.494 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 01:58:14.494 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 01:58:14.495 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 01:58:14.495 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 01:58:14.495 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 01:58:14.495 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 01:58:14.495 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 01:58:14.495 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 01:58:14.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:14.558 7f8c1d25a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource analytics-snmp-node: 'tag_refs' 03/20/2025 01:58:14.833 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 01:58:14.833 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 01:58:14.834 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 01:58:14.834 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 01:58:14.834 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 01:58:14.834 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 01:58:14.835 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 01:58:14.835 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 01:58:14.835 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 01:58:14.835 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 01:58:14.836 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 01:58:14.836 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 01:58:14.836 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 01:58:14.836 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 01:58:14.837 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 01:58:14.837 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 01:58:14.837 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 01:58:14.837 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 01:58:14.838 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 01:58:14.838 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 01:58:14.838 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 01:58:14.838 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 01:58:14.839 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 01:58:14.839 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 01:58:14.839 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 01:58:14.839 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 01:58:14.840 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 01:58:14.840 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 01:58:14.843 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 01:58:14.843 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 01:58:14.843 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 01:58:14.843 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 01:58:14.843 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 01:58:14.843 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 01:58:14.950 7f8c1cef8cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource analytics-snmp-node: 'tag_refs' 03/20/2025 01:58:15.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:16.505 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:17.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:18.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:19.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:20.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:21.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:22.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:23.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:24.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:25.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:26.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:27.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:28.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:29.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:30.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:31.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:32.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:33.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:34.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:35.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:37.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:38.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:39.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:40.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:41.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:42.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:43.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:44.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:45.505 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:46.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:46.626 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_routers in resource routing-instance: 'bgp_routers' 03/20/2025 01:58:46.627 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_refs in resource routing-instance: 'routing_instance_refs' 03/20/2025 01:58:46.627 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_target_refs in resource routing-instance: 'route_target_refs' 03/20/2025 01:58:46.627 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource routing-instance: 'tag_refs' 03/20/2025 01:58:46.627 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource routing-instance: 'virtual_machine_interface_back_refs' 03/20/2025 01:58:46.627 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_aggregate_back_refs in resource routing-instance: 'route_aggregate_back_refs' 03/20/2025 01:58:46.627 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_back_refs in resource routing-instance: 'routing_policy_back_refs' 03/20/2025 01:58:46.627 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_back_refs in resource routing-instance: 'routing_instance_back_refs' 03/20/2025 01:58:46.777 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zone_refs in resource bgp-router: 'control_node_zone_refs' 03/20/2025 01:58:46.777 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource bgp-router: 'sub_cluster_refs' 03/20/2025 01:58:46.777 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource bgp-router: 'bgp_router_refs' 03/20/2025 01:58:46.777 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource bgp-router: 'tag_refs' 03/20/2025 01:58:46.777 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource bgp-router: 'physical_router_back_refs' 03/20/2025 01:58:46.777 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource bgp-router: 'virtual_machine_interface_back_refs' 03/20/2025 01:58:46.777 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_as_a_service_back_refs in resource bgp-router: 'bgp_as_a_service_back_refs' 03/20/2025 01:58:46.777 7f8c1e7238d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_back_refs in resource bgp-router: 'bgp_router_back_refs' 03/20/2025 01:58:46.830 7f8c1c68eb70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 570d268f-da98-44de-afbe-9bf0aad35ec1 object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2923-1 url = http://10.0.0.42:8082/bgp-router/570d268f-da98-44de-afbe-9bf0aad35ec1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.42 body = {"bgp-router": {"uuid": "570d268f-da98-44de-afbe-9bf0aad35ec1", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.11", "address": "10.20.0.11", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:58:46.875 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-1'], 'oper': 'UPDATE', 'request-id': 'req-68738e22-6367-4b3a-a0fa-2b3967ee2a3e', 'type': 'bgp_router', 'uuid': '570d268f-da98-44de-afbe-9bf0aad35ec1'} 03/20/2025 01:58:46.892 7f8c1d828198 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 01:58:47.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:48.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:49.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:50.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:51.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:52.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:53.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:54.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:55.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:56.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:57.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:58.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:58:59.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:00.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:01.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:02.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:03.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:04.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:05.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:07.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:08.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:09.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:10.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:11.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:12.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:13.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:14.505 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:15.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:16.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:17.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:18.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:19.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:20.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:21.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:22.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:23.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:24.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:25.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:26.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:27.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:28.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:29.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:30.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:31.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:32.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:33.147 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_routers in resource routing-instance: 'bgp_routers' 03/20/2025 01:59:33.148 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_refs in resource routing-instance: 'routing_instance_refs' 03/20/2025 01:59:33.148 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_target_refs in resource routing-instance: 'route_target_refs' 03/20/2025 01:59:33.148 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource routing-instance: 'tag_refs' 03/20/2025 01:59:33.148 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource routing-instance: 'virtual_machine_interface_back_refs' 03/20/2025 01:59:33.148 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_aggregate_back_refs in resource routing-instance: 'route_aggregate_back_refs' 03/20/2025 01:59:33.148 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_back_refs in resource routing-instance: 'routing_policy_back_refs' 03/20/2025 01:59:33.148 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_back_refs in resource routing-instance: 'routing_instance_back_refs' 03/20/2025 01:59:33.310 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zone_refs in resource bgp-router: 'control_node_zone_refs' 03/20/2025 01:59:33.310 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource bgp-router: 'sub_cluster_refs' 03/20/2025 01:59:33.310 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource bgp-router: 'bgp_router_refs' 03/20/2025 01:59:33.310 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource bgp-router: 'tag_refs' 03/20/2025 01:59:33.310 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource bgp-router: 'physical_router_back_refs' 03/20/2025 01:59:33.310 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource bgp-router: 'virtual_machine_interface_back_refs' 03/20/2025 01:59:33.310 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_as_a_service_back_refs in resource bgp-router: 'bgp_as_a_service_back_refs' 03/20/2025 01:59:33.310 7f8c1d24f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_back_refs in resource bgp-router: 'bgp_router_back_refs' 03/20/2025 01:59:33.320 7f8c1d72e0f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fe1793f3-c106-4fc5-a5e2-8348694b80e5 object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2923-2 url = http://10.0.0.42:8082/bgp-router/fe1793f3-c106-4fc5-a5e2-8348694b80e5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"bgp-router": {"uuid": "fe1793f3-c106-4fc5-a5e2-8348694b80e5", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.23", "address": "10.20.0.23", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}}} domain = default-domain project = admin user = admin >> 03/20/2025 01:59:33.362 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-2'], 'oper': 'UPDATE', 'request-id': 'req-bfcd099b-e483-4cfa-96a3-a573773825e9', 'type': 'bgp_router', 'uuid': 'fe1793f3-c106-4fc5-a5e2-8348694b80e5'} 03/20/2025 01:59:33.381 7f8c1d828198 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 01:59:33.533 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:34.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:35.536 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:37.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:38.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:39.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:40.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:41.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:42.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:43.505 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:44.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:45.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:46.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:47.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:48.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:49.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:50.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:51.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:52.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:53.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:54.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:55.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:56.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:57.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:58.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 01:59:59.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:00.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:01.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:02.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:03.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:04.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:05.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:07.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:08.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:09.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:10.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:11.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:12.505 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:13.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:14.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:15.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:16.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:16.811 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_routers in resource routing-instance: 'bgp_routers' 03/20/2025 02:00:16.811 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_refs in resource routing-instance: 'routing_instance_refs' 03/20/2025 02:00:16.811 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_target_refs in resource routing-instance: 'route_target_refs' 03/20/2025 02:00:16.811 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource routing-instance: 'tag_refs' 03/20/2025 02:00:16.811 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource routing-instance: 'virtual_machine_interface_back_refs' 03/20/2025 02:00:16.811 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_aggregate_back_refs in resource routing-instance: 'route_aggregate_back_refs' 03/20/2025 02:00:16.811 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_back_refs in resource routing-instance: 'routing_policy_back_refs' 03/20/2025 02:00:16.811 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_back_refs in resource routing-instance: 'routing_instance_back_refs' 03/20/2025 02:00:16.974 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zone_refs in resource bgp-router: 'control_node_zone_refs' 03/20/2025 02:00:16.974 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource bgp-router: 'sub_cluster_refs' 03/20/2025 02:00:16.974 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource bgp-router: 'bgp_router_refs' 03/20/2025 02:00:16.974 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource bgp-router: 'tag_refs' 03/20/2025 02:00:16.974 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource bgp-router: 'physical_router_back_refs' 03/20/2025 02:00:16.974 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource bgp-router: 'virtual_machine_interface_back_refs' 03/20/2025 02:00:16.974 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_as_a_service_back_refs in resource bgp-router: 'bgp_as_a_service_back_refs' 03/20/2025 02:00:16.975 7f8c1d72e240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_back_refs in resource bgp-router: 'bgp_router_back_refs' 03/20/2025 02:00:16.985 7f8c1d72eeb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1fef0d31-ed15-4749-b838-f111e6008e33 object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2923-3 url = http://10.0.0.42:8082/bgp-router/1fef0d31-ed15-4749-b838-f111e6008e33 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.47 body = {"bgp-router": {"uuid": "1fef0d31-ed15-4749-b838-f111e6008e33", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.5", "address": "10.20.0.5", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}}} domain = default-domain project = admin user = admin >> 03/20/2025 02:00:17.008 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2923-3'], 'oper': 'UPDATE', 'request-id': 'req-1de06adb-58b4-4734-9ffc-95602b92f4ba', 'type': 'bgp_router', 'uuid': '1fef0d31-ed15-4749-b838-f111e6008e33'} 03/20/2025 02:00:17.035 7f8c1d828198 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 03/20/2025 02:00:17.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:18.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:19.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:20.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:21.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:22.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:23.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:24.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:25.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:26.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:27.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:28.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:29.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:30.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:31.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:32.533 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:33.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:34.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:35.536 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:37.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:38.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:39.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:40.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:41.112 7f8c1d828198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 03/20/2025 02:00:41.157 7f8c1d828198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 03/20/2025 02:00:41.193 7f8c1d351c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: KombuAmqpClient: Connection error in Kombu amqp consumer greenlet: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/cfgm_common/kombu_amqp.py", line 189, in _start_consuming self._connection.drain_events(timeout=1) File "/usr/local/lib/python3.6/site-packages/kombu/connection.py", line 318, in drain_events return self.transport.drain_events(self.connection, **kwargs) File "/usr/local/lib/python3.6/site-packages/kombu/transport/pyamqp.py", line 135, in drain_events return connection.drain_events(**kwargs) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 526, in drain_events while not self.blocking_read(timeout): File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 532, in blocking_read return self.on_inbound_frame(frame) File "/usr/local/lib/python3.6/site-packages/amqp/method_framing.py", line 53, in on_frame callback(channel, method_sig, buf, None) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 539, in on_inbound_method method_sig, payload, content, File "/usr/local/lib/python3.6/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method listener(*args) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 669, in _on_close (class_id, method_id), ConnectionError) amqp.exceptions.ConnectionForced: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' 03/20/2025 02:00:41.295 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Ensuring Consumer connection 03/20/2025 02:00:41.300 7f8c1d351c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 03/20/2025 02:00:41.338 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy'] 03/20/2025 02:00:42.341 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:43.342 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:44.344 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:45.346 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:46.347 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:47.349 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:48.350 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:49.351 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:50.352 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:51.354 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:52.355 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:53.357 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:54.358 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:55.360 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:56.361 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:57.362 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:58.363 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:00:59.365 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:00.366 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:01.368 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:02.369 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:03.371 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:04.371 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:05.373 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:06.374 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:07.376 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:08.376 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:09.378 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:10.379 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:10.883 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 02:01:10.883 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 02:01:10.883 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 02:01:10.883 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 02:01:10.883 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 02:01:10.883 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 02:01:10.883 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 02:01:10.884 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 02:01:10.884 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 02:01:10.884 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 02:01:10.884 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 02:01:10.884 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 02:01:10.884 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 02:01:10.884 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 02:01:10.884 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 02:01:10.884 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 02:01:10.884 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 02:01:10.884 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 02:01:10.884 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 02:01:10.884 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 02:01:10.884 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 02:01:10.885 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 02:01:10.885 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 02:01:10.885 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 02:01:10.885 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 02:01:10.885 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 02:01:10.885 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 02:01:10.885 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 02:01:10.885 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 02:01:10.885 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 02:01:10.885 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 02:01:10.885 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 02:01:10.885 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 02:01:10.885 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 02:01:10.990 7f8c1cfc5f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource config-database-node: 'tag_refs' 03/20/2025 02:01:12.302 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:13.303 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:14.303 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:15.305 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:16.306 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:17.307 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:18.308 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:19.309 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:20.311 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:21.312 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:22.313 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:23.315 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:24.316 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:25.322 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:26.323 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:27.323 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:28.324 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:29.326 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:30.327 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:31.328 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:32.329 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:33.330 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:34.332 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:35.333 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:35.632 7f8c1d828f60 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Error in rabbitmq heartbeat greenlet for publish: [Errno 32] Broken pipe 03/20/2025 02:01:36.334 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:37.336 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:38.337 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:39.338 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:40.339 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:42.303 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:43.305 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:44.306 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:45.307 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:46.309 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:47.310 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:48.311 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:49.313 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:50.314 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:51.314 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:52.315 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:53.320 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:53.929 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 02:01:53.929 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 02:01:53.929 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 02:01:53.929 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 02:01:53.929 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 02:01:53.929 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 02:01:53.929 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 02:01:53.929 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 02:01:53.930 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 02:01:53.931 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 02:01:53.931 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 02:01:53.931 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 02:01:53.931 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 02:01:53.931 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 02:01:53.931 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 02:01:53.931 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 02:01:53.931 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 02:01:53.931 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 02:01:53.931 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 02:01:53.931 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 02:01:54.052 7f8c1d0a9828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource database-node: 'tag_refs' 03/20/2025 02:01:54.321 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:55.323 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:56.324 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:57.326 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:58.327 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:01:59.328 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:00.329 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:01.331 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:02.332 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:03.333 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:04.335 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:05.336 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:06.337 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:07.339 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:08.340 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:09.341 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:10.342 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:12.305 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:13.306 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:14.307 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:15.308 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:16.310 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:17.223 7f8c1d828198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 03/20/2025 02:02:17.263 7f8c1d828198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 03/20/2025 02:02:17.312 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:17.318 7f8c1d351c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: KombuAmqpClient: Connection error in Kombu amqp consumer greenlet: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/cfgm_common/kombu_amqp.py", line 189, in _start_consuming self._connection.drain_events(timeout=1) File "/usr/local/lib/python3.6/site-packages/kombu/connection.py", line 318, in drain_events return self.transport.drain_events(self.connection, **kwargs) File "/usr/local/lib/python3.6/site-packages/kombu/transport/pyamqp.py", line 135, in drain_events return connection.drain_events(**kwargs) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 526, in drain_events while not self.blocking_read(timeout): File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 532, in blocking_read return self.on_inbound_frame(frame) File "/usr/local/lib/python3.6/site-packages/amqp/method_framing.py", line 53, in on_frame callback(channel, method_sig, buf, None) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 539, in on_inbound_method method_sig, payload, content, File "/usr/local/lib/python3.6/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method listener(*args) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 669, in _on_close (class_id, method_id), ConnectionError) amqp.exceptions.ConnectionForced: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' 03/20/2025 02:02:17.419 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Ensuring Consumer connection 03/20/2025 02:02:17.434 7f8c1d351c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 03/20/2025 02:02:17.568 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy'] 03/20/2025 02:02:18.572 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:19.574 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:20.579 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:21.580 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:22.581 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:23.581 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:24.583 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:25.584 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:26.584 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:27.585 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:28.586 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:29.586 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:30.587 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:31.588 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:32.590 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:33.591 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:34.593 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:35.594 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:36.595 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:37.596 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:38.598 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:39.599 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:40.600 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:41.601 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:42.602 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:43.603 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:44.605 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:45.606 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:46.607 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:48.435 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:49.437 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:49.835 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 02:02:49.835 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 02:02:49.835 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 02:02:49.836 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 02:02:49.836 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 02:02:49.836 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 02:02:49.836 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 02:02:49.836 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 02:02:49.836 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 02:02:49.836 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 02:02:49.836 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 02:02:49.836 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 02:02:49.836 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 02:02:49.836 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 02:02:49.836 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 02:02:49.836 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 02:02:49.837 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 02:02:49.837 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 02:02:49.837 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 02:02:49.837 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 02:02:49.837 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 02:02:49.837 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 02:02:49.837 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 02:02:49.837 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 02:02:49.837 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 02:02:49.837 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 02:02:49.837 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 02:02:49.837 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 02:02:49.837 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 02:02:49.837 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 02:02:49.838 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 02:02:49.838 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 02:02:49.838 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 02:02:49.838 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 02:02:49.897 7f8c1d010780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource config-database-node: 'tag_refs' 03/20/2025 02:02:50.439 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:51.440 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:52.440 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:53.442 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:54.443 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:55.444 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:56.445 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:57.447 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:58.449 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:02:59.449 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:00.451 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:01.452 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:02.453 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:03.454 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:04.455 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:05.457 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:06.458 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:07.460 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:08.461 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:09.462 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:10.464 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:11.465 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:12.466 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:13.467 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:14.468 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:15.470 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:16.471 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:18.445 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:19.446 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:20.447 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:21.449 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:22.450 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:23.451 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:24.452 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:25.454 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:26.454 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:27.456 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:28.457 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:29.458 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:30.459 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:31.461 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:32.462 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:33.462 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:34.464 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:35.464 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:36.466 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:37.466 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:38.343 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 02:03:38.343 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 02:03:38.343 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 02:03:38.343 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 02:03:38.343 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 02:03:38.343 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 02:03:38.343 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 02:03:38.344 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 02:03:38.344 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 02:03:38.344 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 02:03:38.344 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 02:03:38.344 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 02:03:38.344 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 02:03:38.344 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 02:03:38.344 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 02:03:38.344 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 02:03:38.344 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 02:03:38.344 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 02:03:38.344 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 02:03:38.344 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 02:03:38.344 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 02:03:38.345 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 02:03:38.345 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 02:03:38.345 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 02:03:38.345 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 02:03:38.345 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 02:03:38.345 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 02:03:38.345 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 02:03:38.345 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 02:03:38.345 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 02:03:38.345 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 02:03:38.346 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 02:03:38.346 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 02:03:38.346 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 02:03:38.411 7f8c1ccdaf60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource database-node: 'tag_refs' 03/20/2025 02:03:38.467 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:39.469 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:40.471 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:41.472 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:42.474 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:43.475 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:44.476 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:45.478 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:46.479 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:48.446 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:49.447 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:50.448 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:51.450 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:52.451 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:53.452 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:54.454 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:55.455 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:56.283 7f8c1d828198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 03/20/2025 02:03:56.324 7f8c1d828198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 03/20/2025 02:03:56.351 7f8c1d351c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: KombuAmqpClient: Connection error in Kombu amqp consumer greenlet: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/cfgm_common/kombu_amqp.py", line 189, in _start_consuming self._connection.drain_events(timeout=1) File "/usr/local/lib/python3.6/site-packages/kombu/connection.py", line 318, in drain_events return self.transport.drain_events(self.connection, **kwargs) File "/usr/local/lib/python3.6/site-packages/kombu/transport/pyamqp.py", line 135, in drain_events return connection.drain_events(**kwargs) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 526, in drain_events while not self.blocking_read(timeout): File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 532, in blocking_read return self.on_inbound_frame(frame) File "/usr/local/lib/python3.6/site-packages/amqp/method_framing.py", line 53, in on_frame callback(channel, method_sig, buf, None) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 539, in on_inbound_method method_sig, payload, content, File "/usr/local/lib/python3.6/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method listener(*args) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 669, in _on_close (class_id, method_id), ConnectionError) amqp.exceptions.ConnectionForced: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' 03/20/2025 02:03:56.452 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Ensuring Consumer connection 03/20/2025 02:03:56.481 7f8c1d351c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 03/20/2025 02:03:56.550 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-2923-1..dummy'] 03/20/2025 02:03:57.554 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:58.555 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:03:59.556 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:00.557 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:01.559 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:02.560 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:03.561 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:04.562 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:05.565 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:06.566 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:07.568 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:08.569 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:09.570 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:10.570 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:11.571 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:12.572 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:13.573 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:14.574 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:15.575 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:16.577 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:17.578 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:18.579 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:19.582 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:20.583 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:21.584 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:22.586 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:23.587 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:24.589 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:25.590 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:26.621 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 02:04:26.621 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 02:04:26.621 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 02:04:26.622 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 02:04:26.622 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 02:04:26.622 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 02:04:26.622 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 02:04:26.622 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 02:04:26.622 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 02:04:26.622 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 02:04:26.622 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 02:04:26.622 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 02:04:26.622 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 02:04:26.622 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 02:04:26.622 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 02:04:26.622 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 02:04:26.622 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 02:04:26.623 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 02:04:26.624 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 02:04:26.624 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 02:04:26.686 7f8c1cd0ad68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource config-database-node: 'tag_refs' 03/20/2025 02:04:27.480 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:28.482 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:29.483 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:30.484 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:31.485 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:32.486 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:33.488 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:34.489 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:35.490 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:36.491 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:37.493 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:38.495 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:39.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:40.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:41.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:42.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:43.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:44.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:45.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:46.505 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:47.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:48.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:49.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:50.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:51.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:52.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:53.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:54.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:55.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:57.482 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:58.483 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:04:59.485 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:00.486 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:01.487 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:02.488 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:03.490 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:04.491 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:05.493 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:06.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:07.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:08.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:09.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:10.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:10.606 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 02:05:10.606 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 02:05:10.607 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 02:05:10.607 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 02:05:10.607 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 02:05:10.607 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 02:05:10.607 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 02:05:10.607 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 02:05:10.607 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 02:05:10.607 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 02:05:10.607 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 02:05:10.607 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 02:05:10.607 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 02:05:10.607 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 02:05:10.608 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 02:05:10.608 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 02:05:10.608 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 02:05:10.608 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 02:05:10.608 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 02:05:10.608 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 02:05:10.608 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 02:05:10.608 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 02:05:10.608 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 02:05:10.608 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 02:05:10.609 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 02:05:10.609 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 02:05:10.609 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 02:05:10.609 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 02:05:10.609 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 02:05:10.609 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 02:05:10.609 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 02:05:10.610 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 02:05:10.610 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 02:05:10.610 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 02:05:10.691 7f8c1d258cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource database-node: 'tag_refs' 03/20/2025 02:05:11.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:12.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:13.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:14.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:15.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:16.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:17.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:18.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:19.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:20.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:21.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:22.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:23.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:24.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:25.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:27.483 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:28.485 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:29.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:30.495 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:31.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:32.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:33.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:34.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:35.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:36.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:37.505 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:38.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:39.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:40.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:41.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:42.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:43.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:44.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:45.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:46.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:47.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:48.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:49.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:50.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:51.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:52.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:53.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:54.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:55.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:57.483 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:58.484 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:05:59.485 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:00.487 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:01.488 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:02.489 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:03.491 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:04.493 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:05.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:06.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:07.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:08.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:09.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:10.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:11.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:12.505 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:13.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:14.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:15.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:16.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:17.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:18.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:19.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:20.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:21.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:22.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:23.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:24.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:25.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:27.485 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:28.486 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:29.487 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:30.488 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:31.489 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:32.490 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:33.491 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:34.493 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:35.495 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:36.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:37.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:38.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:39.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:40.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:41.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:42.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:43.505 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:44.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:45.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:46.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:47.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:48.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:49.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:50.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:51.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:52.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:53.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:54.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:55.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:57.486 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:58.487 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:06:59.487 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:00.489 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:01.490 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:02.491 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:03.492 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:04.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:05.495 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:06.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:07.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:08.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:09.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:10.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:11.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:12.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:13.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:14.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:15.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:16.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:17.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:18.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:19.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:20.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:21.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:22.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:23.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:24.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:25.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:27.486 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:28.488 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:29.489 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:30.490 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:31.492 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:32.493 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:33.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:34.495 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:35.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:36.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:37.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:38.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:39.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:40.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:41.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:42.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:43.505 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:44.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:45.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:46.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:47.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:48.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:49.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:50.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:51.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:52.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:53.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:54.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:55.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:57.487 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:58.488 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:07:59.489 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:00.491 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:01.493 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:02.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:03.495 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:04.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:05.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:06.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:07.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:08.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:09.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:10.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:11.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:12.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:13.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:14.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:15.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:16.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:17.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:18.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:19.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:20.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:21.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:22.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:23.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:24.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:25.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:27.489 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:28.490 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:29.492 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:30.493 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:31.495 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:32.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:33.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:34.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:35.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:36.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:37.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:38.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:39.505 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:40.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:41.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:42.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:43.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:44.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:45.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:46.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:47.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:48.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:49.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:50.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:51.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:52.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:53.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:54.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:55.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:57.489 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:58.491 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:08:59.492 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:00.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:01.495 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:02.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:03.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:04.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:05.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:06.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:07.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:08.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:09.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:10.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:11.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:12.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:13.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:14.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:15.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:16.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:17.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:18.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:19.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:20.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:21.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:22.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:23.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:24.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:25.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:27.491 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:28.491 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:29.492 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:30.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:31.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:32.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:33.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:34.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:35.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:36.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:37.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:38.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:39.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:40.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:41.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:42.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:43.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:44.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:45.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:46.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:47.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:48.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:49.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:50.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:51.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:52.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:53.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:54.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:55.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:57.492 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:58.493 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:09:59.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:00.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:01.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:02.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:03.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:04.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:05.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:06.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:07.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:08.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:09.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:10.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:11.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:12.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:13.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:14.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:15.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:16.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:17.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:18.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:19.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:20.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:21.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:22.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:23.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:24.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:25.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:27.493 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:28.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:29.495 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:30.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:31.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:32.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:33.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:34.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:35.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:36.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:37.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:38.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:39.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:40.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:41.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:42.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:43.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:44.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:45.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:46.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:47.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:48.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:49.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:50.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:51.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:52.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:53.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:54.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:55.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:57.494 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:58.495 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:10:59.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:00.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:01.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:02.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:03.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:04.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:05.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:06.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:07.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:08.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:09.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:10.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:11.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:12.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:13.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:14.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:15.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:16.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:17.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:18.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:19.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:20.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:21.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:22.536 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:23.537 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:24.539 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:25.540 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:27.495 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:28.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:29.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:30.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:31.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:32.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:33.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:34.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:35.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:36.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:37.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:38.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:39.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:40.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:41.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:42.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:43.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:44.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:45.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:46.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:47.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:48.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:49.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:50.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:51.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:52.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:53.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:54.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:55.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:57.495 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:58.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:11:59.497 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:00.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:01.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:02.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:03.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:04.505 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:05.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:06.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:07.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:08.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:09.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:10.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:11.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:12.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:13.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:14.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:15.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:16.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:17.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:18.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:19.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:20.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:21.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:22.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:23.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:24.533 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:25.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:27.496 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:28.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:29.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:30.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:31.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:32.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:33.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:34.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:35.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:36.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:37.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:38.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:39.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:40.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:41.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:42.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:43.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:44.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:45.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:46.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:47.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:48.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:49.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:50.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:51.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:52.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:53.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:54.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:55.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:57.498 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:58.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:12:59.500 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:00.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:01.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:02.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:03.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:04.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:05.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:06.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:07.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:08.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:09.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:10.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:11.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:12.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:13.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:14.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:15.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:16.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:17.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:18.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:19.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:20.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:21.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:22.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:23.533 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:24.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:25.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:27.499 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:28.501 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:29.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:30.503 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:31.505 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:32.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:33.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:34.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:35.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:36.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:37.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:38.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:39.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:40.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:41.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:42.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:43.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:44.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:45.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:46.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:47.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:48.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:49.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:50.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:51.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:52.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:53.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:54.536 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:55.537 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:57.502 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:58.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:13:59.504 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:00.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:01.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:02.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:03.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:04.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:05.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:06.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:07.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:08.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:09.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:10.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:11.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:12.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:13.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:14.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:15.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:16.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:17.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:18.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:19.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:20.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:21.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:22.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:23.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:24.537 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:25.539 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:27.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:28.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:29.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:30.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:31.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:32.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:33.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:34.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:35.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:36.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:37.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:38.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:39.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:40.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:41.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:42.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:43.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:44.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:45.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:46.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:47.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:48.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:49.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:50.533 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:51.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:52.538 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:53.539 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:54.541 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:55.542 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:57.505 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:58.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:14:59.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:00.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:01.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:02.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:03.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:04.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:05.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:06.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:07.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:08.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:09.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:10.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:11.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:12.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:13.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:14.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:15.538 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:16.539 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:17.542 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:18.543 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:19.544 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:20.546 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:21.548 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:22.550 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:23.551 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:24.553 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:25.554 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:27.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:28.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:29.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:30.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:31.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:32.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:33.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:34.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:35.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:36.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:37.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:38.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:39.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:40.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:41.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:42.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:43.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:44.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:45.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:46.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:47.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:48.533 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:49.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:50.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:51.536 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:52.538 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:53.539 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:54.541 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:55.542 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:57.506 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:58.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:15:59.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:00.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:01.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:02.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:03.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:04.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:05.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:06.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:07.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:08.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:09.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:10.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:11.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:12.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:13.533 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:14.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:15.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:16.537 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:17.538 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:18.538 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:19.540 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:20.541 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:21.542 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:22.542 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:23.543 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:24.546 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:25.547 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:27.507 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:28.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:29.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:30.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:31.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:32.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:33.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:34.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:35.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:36.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:37.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:38.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:39.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:40.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:41.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:42.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:43.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:44.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:45.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:46.536 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:47.538 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:48.539 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:49.541 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:50.542 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:51.543 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:52.545 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:53.546 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:54.548 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:55.549 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:57.508 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:58.509 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:16:59.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:00.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:01.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:02.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:03.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:04.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:05.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:06.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:07.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:08.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:09.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:10.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:11.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:12.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:13.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:14.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:15.533 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:16.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:17.537 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:18.539 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:19.540 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:20.541 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:21.542 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:22.543 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:23.544 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:24.546 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:25.548 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:27.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:28.511 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:29.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:30.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:31.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:32.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:33.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:34.466 7f8c1f007390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 03/20/2025 02:17:34.466 7f8c1f007390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 03/20/2025 02:17:34.466 7f8c1f007390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 03/20/2025 02:17:34.466 7f8c1f007390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 03/20/2025 02:17:34.466 7f8c1f007390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 03/20/2025 02:17:34.466 7f8c1f007390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 03/20/2025 02:17:34.466 7f8c1f007390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 03/20/2025 02:17:34.467 7f8c1f007390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 03/20/2025 02:17:34.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:35.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:36.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:37.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:38.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:39.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:40.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:41.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:42.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:43.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:44.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:45.533 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:46.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:47.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:48.537 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:49.538 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:50.539 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:51.540 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:52.542 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:53.544 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:54.546 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:55.547 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:57.510 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:58.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:17:58.529 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 02:17:58.530 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 02:17:58.530 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 02:17:58.530 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 02:17:58.530 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 02:17:58.530 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 02:17:58.530 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 02:17:58.530 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 02:17:58.530 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 02:17:58.530 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 02:17:58.530 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 02:17:58.530 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 02:17:58.530 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 02:17:58.531 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 02:17:58.531 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 02:17:58.531 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 02:17:58.531 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 02:17:58.531 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 02:17:58.531 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 02:17:58.531 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 02:17:58.531 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 02:17:58.531 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 02:17:58.531 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 02:17:58.531 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 02:17:58.531 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 02:17:58.531 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 02:17:58.531 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 02:17:58.532 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 02:17:58.532 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 02:17:58.532 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 02:17:58.532 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 02:17:58.532 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 02:17:58.532 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 02:17:58.532 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 02:17:58.592 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_routers in resource routing-instance: 'bgp_routers' 03/20/2025 02:17:58.592 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_refs in resource routing-instance: 'routing_instance_refs' 03/20/2025 02:17:58.592 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_target_refs in resource routing-instance: 'route_target_refs' 03/20/2025 02:17:58.592 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource routing-instance: 'tag_refs' 03/20/2025 02:17:58.592 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource routing-instance: 'virtual_machine_interface_back_refs' 03/20/2025 02:17:58.592 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_aggregate_back_refs in resource routing-instance: 'route_aggregate_back_refs' 03/20/2025 02:17:58.592 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_back_refs in resource routing-instance: 'routing_policy_back_refs' 03/20/2025 02:17:58.592 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_back_refs in resource routing-instance: 'routing_instance_back_refs' 03/20/2025 02:17:58.697 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 03/20/2025 02:17:58.698 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 03/20/2025 02:17:58.698 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 03/20/2025 02:17:58.698 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 03/20/2025 02:17:58.698 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 03/20/2025 02:17:58.698 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 03/20/2025 02:17:58.698 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 03/20/2025 02:17:58.698 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 03/20/2025 02:17:58.749 7f8c1cc7c240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bdec3a00-7762-48dd-b6da-1b5b4cef059d object_type = virtual_router identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-2 url = http://10.0.0.42:8082/virtual-router/bdec3a00-7762-48dd-b6da-1b5b4cef059d operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"virtual-router": {"uuid": "bdec3a00-7762-48dd-b6da-1b5b4cef059d", "virtual_router_dpdk_enabled": false}} domain = default-domain project = admin user = admin >> 03/20/2025 02:17:58.769 7f8c1d828e10 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 03/20/2025 02:17:58.775 7f8c1d828e10 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 03/20/2025 02:17:58.795 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-2'], 'oper': 'UPDATE', 'request-id': 'req-b79b7660-8c8a-4171-a71a-fe643ee55436', 'type': 'virtual_router', 'uuid': 'bdec3a00-7762-48dd-b6da-1b5b4cef059d'} 03/20/2025 02:17:58.810 7f8c1d828198 [contrail-api] [DEBUG]: Add uve in the [ObjectVRouter:ContrailConfigTrace] map 03/20/2025 02:17:58.880 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 03/20/2025 02:17:58.880 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 03/20/2025 02:17:58.880 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 03/20/2025 02:17:58.880 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 03/20/2025 02:17:58.880 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 03/20/2025 02:17:58.880 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 03/20/2025 02:17:58.880 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 03/20/2025 02:17:58.880 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 03/20/2025 02:17:58.981 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_object_refs in resource virtual-machine-interface: 'security_logging_object_refs' 03/20/2025 02:17:58.981 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_refs in resource virtual-machine-interface: 'qos_config_refs' 03/20/2025 02:17:58.981 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_group_refs in resource virtual-machine-interface: 'security_group_refs' 03/20/2025 02:17:58.981 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_refs in resource virtual-machine-interface: 'virtual_machine_interface_refs' 03/20/2025 02:17:58.981 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-machine-interface: 'virtual_machine_refs' 03/20/2025 02:17:58.982 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource virtual-machine-interface: 'bgp_router_refs' 03/20/2025 02:17:58.982 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field port_tuple_refs in resource virtual-machine-interface: 'port_tuple_refs' 03/20/2025 02:17:58.982 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_health_check_refs in resource virtual-machine-interface: 'service_health_check_refs' 03/20/2025 02:17:58.982 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field interface_route_table_refs in resource virtual-machine-interface: 'interface_route_table_refs' 03/20/2025 02:17:58.982 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_interface_refs in resource virtual-machine-interface: 'physical_interface_refs' 03/20/2025 02:17:58.982 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bridge_domain_refs in resource virtual-machine-interface: 'bridge_domain_refs' 03/20/2025 02:17:58.982 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_endpoint_refs in resource virtual-machine-interface: 'service_endpoint_refs' 03/20/2025 02:17:58.982 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_port_group_refs in resource virtual-machine-interface: 'virtual_port_group_refs' 03/20/2025 02:17:58.982 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field port_profile_refs in resource virtual-machine-interface: 'port_profile_refs' 03/20/2025 02:17:58.982 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-machine-interface: 'tag_refs' 03/20/2025 02:17:58.982 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource virtual-machine-interface: 'virtual_machine_interface_back_refs' 03/20/2025 02:17:58.982 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-machine-interface: 'instance_ip_back_refs' 03/20/2025 02:17:58.982 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field subnet_back_refs in resource virtual-machine-interface: 'subnet_back_refs' 03/20/2025 02:17:58.982 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field floating_ip_back_refs in resource virtual-machine-interface: 'floating_ip_back_refs' 03/20/2025 02:17:58.983 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alias_ip_back_refs in resource virtual-machine-interface: 'alias_ip_back_refs' 03/20/2025 02:17:58.983 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field logical_interface_back_refs in resource virtual-machine-interface: 'logical_interface_back_refs' 03/20/2025 02:17:58.983 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_as_a_service_back_refs in resource virtual-machine-interface: 'bgp_as_a_service_back_refs' 03/20/2025 02:17:58.983 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field customer_attachment_back_refs in resource virtual-machine-interface: 'customer_attachment_back_refs' 03/20/2025 02:17:58.983 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field logical_router_back_refs in resource virtual-machine-interface: 'logical_router_back_refs' 03/20/2025 02:17:58.983 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field loadbalancer_pool_back_refs in resource virtual-machine-interface: 'loadbalancer_pool_back_refs' 03/20/2025 02:17:58.983 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_ip_back_refs in resource virtual-machine-interface: 'virtual_ip_back_refs' 03/20/2025 02:17:58.983 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field loadbalancer_back_refs in resource virtual-machine-interface: 'loadbalancer_back_refs' 03/20/2025 02:17:58.983 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_port_group_back_refs in resource virtual-machine-interface: 'virtual_port_group_back_refs' 03/20/2025 02:17:58.983 7f8c1cd77f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field link_aggregation_group_back_refs in resource virtual-machine-interface: 'link_aggregation_group_back_refs' 03/20/2025 02:17:58.992 7f8c1c93cac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bee289fc-5ef8-4ed7-8108-dee18734280d object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-2:vhost0 url = http://10.0.0.42:8082/virtual-machine-interface/bee289fc-5ef8-4ed7-8108-dee18734280d operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2923-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.53 body = {"virtual-machine-interface": {"uuid": "bee289fc-5ef8-4ed7-8108-dee18734280d", "virtual_machine_interface_disable_policy": true}} domain = default-domain project = admin user = admin >> 03/20/2025 02:17:59.016 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-c104ed12-a84e-40de-81ec-3eb926aed193', 'type': 'virtual_machine_interface', 'uuid': 'bee289fc-5ef8-4ed7-8108-dee18734280d'} 03/20/2025 02:17:59.033 7f8c1d828198 [contrail-api] [DEBUG]: Add uve in the [ObjectVMITable:ContrailConfigTrace] map 03/20/2025 02:17:59.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:00.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:00.782 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 03/20/2025 02:18:00.783 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 03/20/2025 02:18:00.783 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 03/20/2025 02:18:00.783 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 03/20/2025 02:18:00.783 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 03/20/2025 02:18:00.783 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 03/20/2025 02:18:00.783 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 03/20/2025 02:18:00.783 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 03/20/2025 02:18:00.783 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 03/20/2025 02:18:00.783 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 03/20/2025 02:18:00.783 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 03/20/2025 02:18:00.783 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 03/20/2025 02:18:00.783 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 03/20/2025 02:18:00.784 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 03/20/2025 02:18:00.784 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 03/20/2025 02:18:00.784 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 03/20/2025 02:18:00.784 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 03/20/2025 02:18:00.784 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 03/20/2025 02:18:00.784 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 03/20/2025 02:18:00.784 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 03/20/2025 02:18:00.784 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 03/20/2025 02:18:00.784 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 03/20/2025 02:18:00.784 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 03/20/2025 02:18:00.784 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 03/20/2025 02:18:00.784 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 03/20/2025 02:18:00.784 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 03/20/2025 02:18:00.785 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 03/20/2025 02:18:00.785 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 03/20/2025 02:18:00.785 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 03/20/2025 02:18:00.785 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 03/20/2025 02:18:00.785 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 03/20/2025 02:18:00.785 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 03/20/2025 02:18:00.785 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 03/20/2025 02:18:00.785 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 03/20/2025 02:18:00.850 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_routers in resource routing-instance: 'bgp_routers' 03/20/2025 02:18:00.850 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_refs in resource routing-instance: 'routing_instance_refs' 03/20/2025 02:18:00.850 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_target_refs in resource routing-instance: 'route_target_refs' 03/20/2025 02:18:00.850 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource routing-instance: 'tag_refs' 03/20/2025 02:18:00.850 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource routing-instance: 'virtual_machine_interface_back_refs' 03/20/2025 02:18:00.851 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_aggregate_back_refs in resource routing-instance: 'route_aggregate_back_refs' 03/20/2025 02:18:00.851 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_back_refs in resource routing-instance: 'routing_policy_back_refs' 03/20/2025 02:18:00.851 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_back_refs in resource routing-instance: 'routing_instance_back_refs' 03/20/2025 02:18:00.954 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 03/20/2025 02:18:00.954 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 03/20/2025 02:18:00.954 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 03/20/2025 02:18:00.955 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 03/20/2025 02:18:00.955 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 03/20/2025 02:18:00.955 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 03/20/2025 02:18:00.955 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 03/20/2025 02:18:00.955 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 03/20/2025 02:18:01.008 7f8c1cc84f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f9426b64-4151-45ad-afea-9635a69025ad object_type = virtual_router identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-1 url = http://10.0.0.42:8082/virtual-router/f9426b64-4151-45ad-afea-9635a69025ad operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"virtual-router": {"uuid": "f9426b64-4151-45ad-afea-9635a69025ad", "virtual_router_dpdk_enabled": false}} domain = default-domain project = admin user = admin >> 03/20/2025 02:18:01.031 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-1'], 'oper': 'UPDATE', 'request-id': 'req-98e92c3e-a1be-4fe6-bdbd-f4a184f9ec50', 'type': 'virtual_router', 'uuid': 'f9426b64-4151-45ad-afea-9635a69025ad'} 03/20/2025 02:18:01.042 7f8c1d828198 [contrail-api] [DEBUG]: Add uve in the [ObjectVRouter:ContrailConfigTrace] map 03/20/2025 02:18:01.138 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 03/20/2025 02:18:01.138 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 03/20/2025 02:18:01.138 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 03/20/2025 02:18:01.138 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 03/20/2025 02:18:01.138 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 03/20/2025 02:18:01.139 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 03/20/2025 02:18:01.139 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 03/20/2025 02:18:01.139 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 03/20/2025 02:18:01.248 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_object_refs in resource virtual-machine-interface: 'security_logging_object_refs' 03/20/2025 02:18:01.249 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_refs in resource virtual-machine-interface: 'qos_config_refs' 03/20/2025 02:18:01.249 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_group_refs in resource virtual-machine-interface: 'security_group_refs' 03/20/2025 02:18:01.249 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_refs in resource virtual-machine-interface: 'virtual_machine_interface_refs' 03/20/2025 02:18:01.249 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-machine-interface: 'virtual_machine_refs' 03/20/2025 02:18:01.249 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource virtual-machine-interface: 'bgp_router_refs' 03/20/2025 02:18:01.249 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field port_tuple_refs in resource virtual-machine-interface: 'port_tuple_refs' 03/20/2025 02:18:01.249 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_health_check_refs in resource virtual-machine-interface: 'service_health_check_refs' 03/20/2025 02:18:01.249 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field interface_route_table_refs in resource virtual-machine-interface: 'interface_route_table_refs' 03/20/2025 02:18:01.249 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_interface_refs in resource virtual-machine-interface: 'physical_interface_refs' 03/20/2025 02:18:01.249 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bridge_domain_refs in resource virtual-machine-interface: 'bridge_domain_refs' 03/20/2025 02:18:01.249 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_endpoint_refs in resource virtual-machine-interface: 'service_endpoint_refs' 03/20/2025 02:18:01.249 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_port_group_refs in resource virtual-machine-interface: 'virtual_port_group_refs' 03/20/2025 02:18:01.250 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field port_profile_refs in resource virtual-machine-interface: 'port_profile_refs' 03/20/2025 02:18:01.250 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-machine-interface: 'tag_refs' 03/20/2025 02:18:01.250 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource virtual-machine-interface: 'virtual_machine_interface_back_refs' 03/20/2025 02:18:01.250 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-machine-interface: 'instance_ip_back_refs' 03/20/2025 02:18:01.250 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field subnet_back_refs in resource virtual-machine-interface: 'subnet_back_refs' 03/20/2025 02:18:01.250 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field floating_ip_back_refs in resource virtual-machine-interface: 'floating_ip_back_refs' 03/20/2025 02:18:01.250 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alias_ip_back_refs in resource virtual-machine-interface: 'alias_ip_back_refs' 03/20/2025 02:18:01.250 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field logical_interface_back_refs in resource virtual-machine-interface: 'logical_interface_back_refs' 03/20/2025 02:18:01.250 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_as_a_service_back_refs in resource virtual-machine-interface: 'bgp_as_a_service_back_refs' 03/20/2025 02:18:01.250 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field customer_attachment_back_refs in resource virtual-machine-interface: 'customer_attachment_back_refs' 03/20/2025 02:18:01.250 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field logical_router_back_refs in resource virtual-machine-interface: 'logical_router_back_refs' 03/20/2025 02:18:01.250 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field loadbalancer_pool_back_refs in resource virtual-machine-interface: 'loadbalancer_pool_back_refs' 03/20/2025 02:18:01.250 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_ip_back_refs in resource virtual-machine-interface: 'virtual_ip_back_refs' 03/20/2025 02:18:01.250 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field loadbalancer_back_refs in resource virtual-machine-interface: 'loadbalancer_back_refs' 03/20/2025 02:18:01.251 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_port_group_back_refs in resource virtual-machine-interface: 'virtual_port_group_back_refs' 03/20/2025 02:18:01.251 7f8c1d06b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field link_aggregation_group_back_refs in resource virtual-machine-interface: 'link_aggregation_group_back_refs' 03/20/2025 02:18:01.265 7f8c1d053630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 99d8afe0-d28d-4daf-bf3a-8b7a18eace27 object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-1:vhost0 url = http://10.0.0.42:8082/virtual-machine-interface/99d8afe0-d28d-4daf-bf3a-8b7a18eace27 operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2923-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.29 body = {"virtual-machine-interface": {"uuid": "99d8afe0-d28d-4daf-bf3a-8b7a18eace27", "virtual_machine_interface_disable_policy": true}} domain = default-domain project = admin user = admin >> 03/20/2025 02:18:01.295 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2923-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-28a5923e-3b8b-4493-a476-f73042e318d1', 'type': 'virtual_machine_interface', 'uuid': '99d8afe0-d28d-4daf-bf3a-8b7a18eace27'} 03/20/2025 02:18:01.313 7f8c1d828198 [contrail-api] [DEBUG]: Add uve in the [ObjectVMITable:ContrailConfigTrace] map 03/20/2025 02:18:01.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:02.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:03.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:04.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:05.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:06.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:07.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:08.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:09.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:10.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:11.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:12.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:13.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:14.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:15.533 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:16.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:17.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:18.536 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:19.117 7f8c1cd0ab70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 03/20/2025 02:18:19.120 7f8c1cd0ab70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 02:18:19.538 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:20.539 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:21.541 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:22.542 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:23.543 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:24.545 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:25.546 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:27.512 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:28.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:29.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:30.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:31.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:32.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:33.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:34.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:35.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:36.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:37.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:37.840 7f8c1cd6cc18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 03/20/2025 02:18:37.845 7f8c1cd6cc18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 02:18:38.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:39.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:40.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:41.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:42.533 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:43.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:44.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:45.536 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:46.538 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:47.539 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:48.541 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:49.542 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:50.545 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:51.547 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:52.548 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:53.549 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:54.550 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:55.552 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:57.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:58.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:18:59.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:00.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:01.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:02.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:03.521 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:04.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:05.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:06.524 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:07.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:08.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:09.528 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:10.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:11.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:12.533 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:13.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:14.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:15.536 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:16.538 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:17.539 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:18.541 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:19.542 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:20.544 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:21.545 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:22.546 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:23.547 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:24.548 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:25.550 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:27.513 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:28.514 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:29.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:30.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:31.518 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:32.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:33.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:34.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:35.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:36.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:37.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:38.527 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:39.529 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:40.530 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:41.531 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:42.532 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:43.534 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:44.535 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:45.537 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:46.538 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:47.539 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:48.540 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:49.542 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:50.542 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:51.544 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:52.545 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:53.546 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:54.548 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:55.549 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:57.515 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:58.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:59.516 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:19:59.778 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'admin'], 'obj_dict': {'display_name': 'admin', 'fq_name': ['default-domain', 'admin'], 'id_perms': {'created': '2025-03-20T02:19:59.751788', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T02:19:59.751788', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12698628246171273318, 'uuid_mslong': 5936447301116578626}}, 'parent_type': 'domain', 'parent_uuid': '78cb90fb-efc3-49d9-aab8-3061c7ab1bd1', 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '52627f5e-22e1-4b42-b03a-971c13c7c866'}, 'oper': 'CREATE', 'request-id': 'req-301f1258-e7b2-4be0-a113-9e6e40616e86', 'type': 'project', 'uuid': '52627f5e-22e1-4b42-b03a-971c13c7c866'} 03/20/2025 02:19:59.779 7f8c1d828198 [contrail-api] [DEBUG]: Add uve in the [ObjectProjectTable:ContrailConfigTrace] map 03/20/2025 02:19:59.867 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'admin', 'default-application-policy-set'], 'obj_dict': {'all_applications': True, 'display_name': 'default-application-policy-set', 'fq_name': ['default-domain', 'admin', 'default-application-policy-set'], 'id_perms': {'created': '2025-03-20T02:19:59.855745', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T02:19:59.855745', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13512061843784024429, 'uuid_mslong': 11403750445478331333}}, 'parent_type': 'project', 'parent_uuid': '52627f5e-22e1-4b42-b03a-971c13c7c866', 'perms2': {'global_access': 0, 'owner': '52627f5e22e14b42b03a971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '9e42429c-49f0-43c5-bb84-7ca82ddb416d'}, 'oper': 'CREATE', 'request-id': 'req-301f1258-e7b2-4be0-a113-9e6e40616e86', 'type': 'application_policy_set', 'uuid': '9e42429c-49f0-43c5-bb84-7ca82ddb416d'} 03/20/2025 02:19:59.867 7f8c1d828198 [contrail-api] [DEBUG]: Add uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 03/20/2025 02:19:59.928 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'admin'], 'oper': 'UPDATE', 'request-id': 'req-301f1258-e7b2-4be0-a113-9e6e40616e86', 'type': 'project', 'uuid': '52627f5e-22e1-4b42-b03a-971c13c7c866'} 03/20/2025 02:20:00.122 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'admin', 'default'], 'obj_dict': {'display_name': 'default', 'fq_name': ['default-domain', 'admin', 'default'], 'id_perms': {'created': '2025-03-20T02:20:00.056142', 'creator': None, 'description': 'Default security group', 'enable': True, 'last_modified': '2025-03-20T02:20:00.056142', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13682224381536048545, 'uuid_mslong': 5970223878158041210}}, 'parent_type': 'project', 'parent_uuid': '52627f5e-22e1-4b42-b03a-971c13c7c866', 'perms2': {'global_access': 0, 'owner': '52627f5e-22e1-4b42-b03a-971c13c7c866', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': [{'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': 'f682a632-48bc-4a9c-a7a4-edf48f097764', 'src_addresses': [{'network_policy': None, 'security_group': 'default-domain:admin:default', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': 'fa2bbe96-1dc5-48c5-8f2b-b8c0866c80ac', 'src_addresses': [{'network_policy': None, 'security_group': 'default-domain:admin:default', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '16cb4eca-c378-494b-80ea-fa54e031439c', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '78cfe731-b82d-4250-906c-ce53de8dd954', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}]}, 'security_group_id': 8000002, 'uuid': '52da7efc-4f2a-407a-bde1-06955ea515a1'}, 'oper': 'CREATE', 'request-id': 'req-f6b5a83c-184a-4a8b-b759-de023e7106f9', 'type': 'security_group', 'uuid': '52da7efc-4f2a-407a-bde1-06955ea515a1'} 03/20/2025 02:20:00.292 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'admin', 'default', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': '8000002', 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': 'f682a632-48bc-4a9c-a7a4-edf48f097764'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': '8000002', 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': 'fa2bbe96-1dc5-48c5-8f2b-b8c0866c80ac'}], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'admin', 'default', 'ingress-access-control-list'], 'id_perms': {'created': '2025-03-20T02:20:00.278324', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T02:20:00.278324', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12310274697726772263, 'uuid_mslong': 16742645715548850694}}, 'parent_type': 'security-group', 'parent_uuid': '52da7efc-4f2a-407a-bde1-06955ea515a1', 'perms2': {'global_access': 0, 'owner': '52627f5e-22e1-4b42-b03a-971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': 'e859d392-6b81-4a06-aad6-e19d6d7bc427'}, 'oper': 'CREATE', 'request-id': 'req-1ca74346-358d-40fe-abda-01ff149ee461', 'type': 'access_control_list', 'uuid': 'e859d392-6b81-4a06-aad6-e19d6d7bc427'} 03/20/2025 02:20:00.331 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'admin'], 'oper': 'UPDATE', 'request-id': 'req-aa65f253-a999-4293-9dfd-232df85cf2f3', 'type': 'project', 'uuid': '52627f5e-22e1-4b42-b03a-971c13c7c866'} 03/20/2025 02:20:00.444 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'admin', 'default', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '16cb4eca-c378-494b-80ea-fa54e031439c'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '78cfe731-b82d-4250-906c-ce53de8dd954'}], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'admin', 'default', 'egress-access-control-list'], 'id_perms': {'created': '2025-03-20T02:20:00.406189', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T02:20:00.406189', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12258745413636017993, 'uuid_mslong': 8487621826196226505}}, 'parent_type': 'security-group', 'parent_uuid': '52da7efc-4f2a-407a-bde1-06955ea515a1', 'perms2': {'global_access': 0, 'owner': '52627f5e-22e1-4b42-b03a-971c13c7c866', 'owner_access': 7, 'share': []}, 'uuid': '75ca1714-e247-41c9-aa1f-d0010bb94f49'}, 'oper': 'CREATE', 'request-id': 'req-9f7f88f1-6430-4429-8857-ec1c637edca0', 'type': 'access_control_list', 'uuid': '75ca1714-e247-41c9-aa1f-d0010bb94f49'} 03/20/2025 02:20:00.517 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:20:01.386 7f8c1ce11588 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 02:20:01.519 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:20:02.520 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:20:03.154 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179'], 'obj_dict': {'display_name': 'ctest-AnalyticsBasicTestSanity-41612179', 'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179'], 'id_perms': {'created': '2025-03-20T02:20:03.144927', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T02:20:03.144927', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13255947277742553356, 'uuid_mslong': 3404936407570795853}}, 'parent_type': 'domain', 'parent_uuid': '78cb90fb-efc3-49d9-aab8-3061c7ab1bd1', 'perms2': {'global_access': 0, 'owner': '2f40c39f600d4d4db7f695d0eb26b90c', 'owner_access': 7, 'share': []}, 'uuid': '2f40c39f-600d-4d4d-b7f6-95d0eb26b90c'}, 'oper': 'CREATE', 'request-id': 'req-7a320991-5067-4451-9dd1-c8017c6e0abe', 'type': 'project', 'uuid': '2f40c39f-600d-4d4d-b7f6-95d0eb26b90c'} 03/20/2025 02:20:03.155 7f8c1d828198 [contrail-api] [DEBUG]: Add uve in the [ObjectProjectTable:ContrailConfigTrace] map 03/20/2025 02:20:03.229 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179', 'default-application-policy-set'], 'obj_dict': {'all_applications': True, 'display_name': 'default-application-policy-set', 'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179', 'default-application-policy-set'], 'id_perms': {'created': '2025-03-20T02:20:03.219782', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T02:20:03.219782', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12884733282307062560, 'uuid_mslong': 3837260878089110199}}, 'parent_type': 'project', 'parent_uuid': '2f40c39f-600d-4d4d-b7f6-95d0eb26b90c', 'perms2': {'global_access': 0, 'owner': '2f40c39f600d4d4db7f695d0eb26b90c', 'owner_access': 7, 'share': []}, 'uuid': '3540b070-1d01-42b7-b2cf-c4a76d90bb20'}, 'oper': 'CREATE', 'request-id': 'req-7a320991-5067-4451-9dd1-c8017c6e0abe', 'type': 'application_policy_set', 'uuid': '3540b070-1d01-42b7-b2cf-c4a76d90bb20'} 03/20/2025 02:20:03.230 7f8c1d828198 [contrail-api] [DEBUG]: Add uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 03/20/2025 02:20:03.303 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179'], 'oper': 'UPDATE', 'request-id': 'req-7a320991-5067-4451-9dd1-c8017c6e0abe', 'type': 'project', 'uuid': '2f40c39f-600d-4d4d-b7f6-95d0eb26b90c'} 03/20/2025 02:20:03.439 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179', 'default'], 'obj_dict': {'display_name': 'default', 'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179', 'default'], 'id_perms': {'created': '2025-03-20T02:20:03.425818', 'creator': None, 'description': 'Default security group', 'enable': True, 'last_modified': '2025-03-20T02:20:03.425818', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11060146682267462608, 'uuid_mslong': 624361874196548110}}, 'parent_type': 'project', 'parent_uuid': '2f40c39f-600d-4d4d-b7f6-95d0eb26b90c', 'perms2': {'global_access': 0, 'owner': '2f40c39f-600d-4d4d-b7f6-95d0eb26b90c', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': [{'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': 'd17708af-5f5a-474b-a5fa-521fda7552a0', 'src_addresses': [{'network_policy': None, 'security_group': 'default-domain:ctest-AnalyticsBasicTestSanity-41612179:default', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '46a4a0ad-9a36-4fc7-9a37-2b8773244f1f', 'src_addresses': [{'network_policy': None, 'security_group': 'default-domain:ctest-AnalyticsBasicTestSanity-41612179:default', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv4', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '703b8cfc-76b3-4342-bd01-d6986c866a40', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}, {'action_list': None, 'application': [], 'created': None, 'description': None, 'direction': '>', 'dst_addresses': [{'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}], 'dst_ports': [{'end_port': 65535, 'start_port': 0}], 'ethertype': 'IPv6', 'last_modified': None, 'protocol': 'any', 'rule_sequence': None, 'rule_uuid': '602402c4-e581-4545-a7b4-2fe29ce99fe9', 'src_addresses': [{'network_policy': None, 'security_group': 'local', 'subnet': None, 'subnet_list': [], 'virtual_network': None}], 'src_ports': [{'end_port': 65535, 'start_port': 0}]}]}, 'security_group_id': 8000003, 'uuid': '08aa2dd1-0ac8-4a0e-997d-88cef0446bd0'}, 'oper': 'CREATE', 'request-id': 'req-cef37ea7-143a-49c5-8cac-bd9905fb3a84', 'type': 'security_group', 'uuid': '08aa2dd1-0ac8-4a0e-997d-88cef0446bd0'} 03/20/2025 02:20:03.488 7f8c1d25b198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179', 'default', 'ingress-access-control-list'] not found in DB: Unknown id: access_control_list default-domain:ctest-AnalyticsBasicTestSanity-41612179:default:ingress-access-control-list 03/20/2025 02:20:03.495 7f8c1c7d0198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = access_control_list identifier_name = default-domain:ctest-AnalyticsBasicTestSanity-41612179:default:ingress-access-control-list url = http://10.0.0.42:8082/access-control-lists operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2923-3:/usr/local/bin/contrail-schema remote_ip = 10.0.0.47 body = {"access-control-list": {"uuid": null, "fq_name": ["default-domain", "ctest-AnalyticsBasicTestSanity-41612179", "default", "ingress-access-control-list"], "parent_type": "security-group", "access_control_list_entries": {"dynamic": null, "acl_rule": [{"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": null, "security_group": "8000003", "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": null, "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": "IPv4"}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "d17708af-5f5a-474b-a5fa-521fda7552a0", "direction": null}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": null, "security_group": "8000003", "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": null, "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": "IPv6"}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "46a4a0ad-9a36-4fc7-9a37-2b8773244f1f", "direction": null}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "2f40c39f-600d-4d4d-b7f6-95d0eb26b90c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ingress-access-control-list"}} domain = default-domain project = admin user = admin >> 03/20/2025 02:20:03.522 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:20:03.539 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179', 'default', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': '8000003', 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': 'd17708af-5f5a-474b-a5fa-521fda7552a0'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': '8000003', 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '46a4a0ad-9a36-4fc7-9a37-2b8773244f1f'}], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179', 'default', 'ingress-access-control-list'], 'id_perms': {'created': '2025-03-20T02:20:03.522487', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T02:20:03.522487', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10190066029680731560, 'uuid_mslong': 16082949144106451079}}, 'parent_type': 'security-group', 'parent_uuid': '08aa2dd1-0ac8-4a0e-997d-88cef0446bd0', 'perms2': {'global_access': 0, 'owner': '2f40c39f-600d-4d4d-b7f6-95d0eb26b90c', 'owner_access': 7, 'share': []}, 'uuid': 'df321d09-1323-4087-8d6a-631090e525a8'}, 'oper': 'CREATE', 'request-id': 'req-155fd3be-3d41-4228-8d0c-52895c95fdc1', 'type': 'access_control_list', 'uuid': 'df321d09-1323-4087-8d6a-631090e525a8'} 03/20/2025 02:20:03.614 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179'], 'oper': 'UPDATE', 'request-id': 'req-b066eb9e-684b-417d-9e72-a229116286f3', 'type': 'project', 'uuid': '2f40c39f-600d-4d4d-b7f6-95d0eb26b90c'} 03/20/2025 02:20:03.670 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179', 'default', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv4', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '703b8cfc-76b3-4342-bd01-d6986c866a40'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': {'ip_prefix': '::', 'ip_prefix_len': 0}, 'subnet_list': [], 'virtual_network': None}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': 'IPv6', 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': None}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '602402c4-e581-4545-a7b4-2fe29ce99fe9'}], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179', 'default', 'egress-access-control-list'], 'id_perms': {'created': '2025-03-20T02:20:03.653502', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T02:20:03.653502', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11846682576804078950, 'uuid_mslong': 12444077169677451568}}, 'parent_type': 'security-group', 'parent_uuid': '08aa2dd1-0ac8-4a0e-997d-88cef0446bd0', 'perms2': {'global_access': 0, 'owner': '2f40c39f-600d-4d4d-b7f6-95d0eb26b90c', 'owner_access': 7, 'share': []}, 'uuid': 'acb23e41-182c-4130-a467-df0985376566'}, 'oper': 'CREATE', 'request-id': 'req-28606467-fbd5-4aa0-a029-afb24bcf0c25', 'type': 'access_control_list', 'uuid': 'acb23e41-182c-4130-a467-df0985376566'} 03/20/2025 02:20:04.523 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:20:05.525 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:20:06.261 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179'], 'oper': 'UPDATE', 'request-id': 'req-ae755c18-4301-4781-a4b4-0059e210b409', 'type': 'project', 'uuid': '2f40c39f-600d-4d4d-b7f6-95d0eb26b90c'} 03/20/2025 02:20:06.474 7f8c1e1bc780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: VNC OpenStack: [req-37339412-84ff-49e2-8cfd-003003e7a7cb 2f40c39f600d4d4db7f695d0eb26b90c a0b61c52c1b44c748dcb3ef5c2f431b3] READALL network "GET /" 200 34400 0.000455 03/20/2025 02:20:06.479 7f8c1e1bc780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Inconsistency discovered. wanted=1, received=0, missing={'2f40c39f-600d-4d4d-b7f6-95d0eb26b90c'}. This may indicate that the cluster needs a 'nodetool repair'. 03/20/2025 02:20:06.479 7f8c1e1bc780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: VNC OpenStack: [req-37339412-84ff-49e2-8cfd-003003e7a7cb 2f40c39f600d4d4db7f695d0eb26b90c a0b61c52c1b44c748dcb3ef5c2f431b3] READALL network "GET /virtual-networks?parent_id=2f40c39f-600d-4d4d-b7f6-95d0eb26b90c&detail=True&count=False&shared=False&exclude_hrefs=True" 200 24 0.003510 03/20/2025 02:20:06.490 7f8c1e1bc780 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Inconsistency discovered. wanted=5, received=0, missing={'826220c5-748a-4986-b4b8-2a6455c02f53', '2dd3a4f5-b224-426d-9846-3b0076ad64d3', '25e81aa2-d36c-4b63-8506-67606ce5b850', 'dfd6c58d-aef7-4acd-afde-fc1db450d58d', '5410dc33-3e3a-47af-aff2-8866b04f18ce'}. This may indicate that the cluster needs a 'nodetool repair'. 03/20/2025 02:20:06.491 7f8c1e1bc780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: VNC OpenStack: [req-37339412-84ff-49e2-8cfd-003003e7a7cb 2f40c39f600d4d4db7f695d0eb26b90c a0b61c52c1b44c748dcb3ef5c2f431b3] READALL network "GET /virtual-networks?detail=True&count=False&shared=False&filters=router_external==true&exclude_hrefs=True" 200 24 0.011357 03/20/2025 02:20:06.526 7f8c1d351c18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 03/20/2025 02:20:06.728 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179'], 'oper': 'UPDATE', 'request-id': 'req-d9f921ee-9817-4802-ae39-93303184b6b5', 'type': 'project', 'uuid': '2f40c39f-600d-4d4d-b7f6-95d0eb26b90c'} 03/20/2025 02:20:06.831 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179', 'ctest-vn22-97468500'], 'obj_dict': {'display_name': 'ctest-vn22-97468500', 'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179', 'ctest-vn22-97468500'], 'id_perms': {'created': '2025-03-20T02:20:06.820057', 'creator': None, 'description': '', 'enable': True, 'last_modified': '2025-03-20T02:20:06.820057', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'ctest-AnalyticsBasicTestSanity-41612179', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9596944221341458124, 'uuid_mslong': 300784103271973179}}, 'is_shared': False, 'mtu': 0, 'network_policy_refs': [], 'parent_type': 'project', 'parent_uuid': '2f40c39f-600d-4d4d-b7f6-95d0eb26b90c', 'perms2': {'global_access': 0, 'owner': '2f40c39f600d4d4db7f695d0eb26b90c', 'owner_access': 7, 'share': []}, 'port_security_enabled': True, 'router_external': False, 'uuid': '042c998c-5d9c-413b-852f-31ec2a4b9ecc', 'virtual_network_network_id': 6}, 'oper': 'CREATE', 'request-id': 'req-dba685a6-5de1-4a64-a810-54dda835c4e9', 'type': 'virtual_network', 'uuid': '042c998c-5d9c-413b-852f-31ec2a4b9ecc'} 03/20/2025 02:20:06.831 7f8c1d828198 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 03/20/2025 02:20:06.922 7f8c1d828198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179', 'ctest-vn22-97468500', 'ctest-vn22-97468500'], 'obj_dict': {'display_name': 'ctest-vn22-97468500', 'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-41612179', 'ctest-vn22-97468500', 'ctest-vn22-97468500'], 'id_perms': {'created': '2025-03-20T02:20:06.906212', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-20T02:20:06.906212', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10286381245770805691, 'uuid_mslong': 17436698871186538590}}, 'parent_type': 'virtual-network', 'parent_uuid': '042c998c-5d9c-413b-852f-31ec2a4b9ecc', 'perms2': {'global_access': 0, 'owner': '2f40c39f600d4d4db7f695d0eb26b90c', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': 'f1fb993d-6087-405e-8ec0-913e5268b1bb'}, 'oper': 'CREATE', 'request-id': 'req-dba685a6-5de1-4a64-a810-54dda835c4e9', 'type': 'routing_instance', 'uuid': 'f1fb993d-6087-405e-8ec0-913e5268b1bb'}