06/02/2025 02:07:26.230 7fad8c3713c8 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 06/02/2025 02:07:26.230 7fad8c3713c8 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 06/02/2025 02:07:26.230 7fad8c3713c8 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 06/02/2025 02:07:26.231 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.129:2181 06/02/2025 02:07:26.231 7fad8c3713c8 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:07:26.232 7fad861a1048 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 06/02/2025 02:07:26.233 7fad861a1048 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 06/02/2025 02:07:26.234 7fad861a0978 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 06/02/2025 02:07:26.237 7fad861a0978 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/02/2025 02:07:26.238 7fad861a0978 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 06/02/2025 02:07:26.241 7fad861a0978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:26.241 7fad861a0978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 06/02/2025 02:07:26.241 7fad861a0978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:26.241 7fad861a0978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:26.241 7fad861a0978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/02/2025 02:07:26.241 7fad861a0978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:26.241 7fad861a0978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:26.241 7fad861a0978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 06/02/2025 02:07:26.247 7fad861a0978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:26.291 7fad86916240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:26.291 7fad86916240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/02/2025 02:07:26.296 7fad86916240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:26.563 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.129:9041'] 06/02/2025 02:07:26.563 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 06/02/2025 02:07:26.563 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 06/02/2025 02:07:26.564 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 06/02/2025 02:07:26.564 7fad8687f240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:26.565 7fad8687f240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 06/02/2025 02:07:26.565 7fad8687f240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:26.566 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 06/02/2025 02:07:27.209 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 06/02/2025 02:07:27.212 7fad868e8d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:27.212 7fad868e8d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 06/02/2025 02:07:27.212 7fad868e8d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:27.219 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 06/02/2025 02:07:27.220 7fad86899c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:27.220 7fad86899c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 06/02/2025 02:07:27.220 7fad86899c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:27.386 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 06/02/2025 02:07:27.845 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'config_db_uuid', created 06/02/2025 02:07:27.872 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 06/02/2025 02:07:27.921 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 06/02/2025 02:07:28.461 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'config_db_uuid' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 06/02/2025 02:07:28.487 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 06/02/2025 02:07:28.504 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 06/02/2025 02:07:29.148 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'useragent', created 06/02/2025 02:07:29.161 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 06/02/2025 02:07:30.237 7fad868b9f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:30.407 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 06/02/2025 02:07:30.997 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'useragent' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 06/02/2025 02:07:31.001 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 06/02/2025 02:07:31.001 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 06/02/2025 02:07:31.357 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 06/02/2025 02:07:33.289 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 06/02/2025 02:07:33.297 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'obj_fq_name_table', created 06/02/2025 02:07:33.304 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 06/02/2025 02:07:34.116 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 06/02/2025 02:07:34.332 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 06/02/2025 02:07:34.337 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 06/02/2025 02:07:35.241 7fad868b9f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:07:35.241 7fad868b9f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:07:35.241 7fad868b9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:35.241 7fad868b9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 06/02/2025 02:07:35.241 7fad868b9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:35.241 7fad868b9f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:07:35.243 7fad868b9f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:07:35.243 7fad868b9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:35.243 7fad868b9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/02/2025 02:07:35.243 7fad868b9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:35.243 7fad868b9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:35.243 7fad868b9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 06/02/2025 02:07:35.244 7fad868b9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:35.801 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 06/02/2025 02:07:35.804 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'obj_shared_table', created 06/02/2025 02:07:35.808 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 06/02/2025 02:07:36.451 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 06/02/2025 02:07:37.144 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 06/02/2025 02:07:37.148 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 06/02/2025 02:07:37.879 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 06/02/2025 02:07:38.094 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'useragent_keyval_table', created 06/02/2025 02:07:38.100 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 06/02/2025 02:07:38.236 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 06/02/2025 02:07:38.414 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'useragent_keyval_table' fixed with properties {'gc_grace_seconds': 864000} 06/02/2025 02:07:38.418 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 06/02/2025 02:07:38.419 7fad915e9390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.419 7fad915e9390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:38.419 7fad915e9390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.548 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.129:5673//'] 06/02/2025 02:07:38.554 7fad86148828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.554 7fad86148828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 06/02/2025 02:07:38.554 7fad86148828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.562 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 06/02/2025 02:07:38.563 7fad86c2b048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.564 7fad86c2b048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 06/02/2025 02:07:38.564 7fad86c2b048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.581 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 06/02/2025 02:07:38.581 7fad86130240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.582 7fad86130240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:38.582 7fad86130240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.598 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 06/02/2025 02:07:38.599 7fad868f2978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.599 7fad868f2978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 06/02/2025 02:07:38.600 7fad868f2978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.616 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 06/02/2025 02:07:38.617 7fad868f2978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.617 7fad868f2978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:38.618 7fad868f2978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.619 7fad868f0cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 06/02/2025 02:07:38.620 7fad868c0ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.620 7fad868c0ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 06/02/2025 02:07:38.620 7fad868c0ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.630 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-global-system-config']: Unknown id: global_system_config default-global-system-config 06/02/2025 02:07:38.641 7fad868f0cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 06/02/2025 02:07:38.642 7fad8623c978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.642 7fad8623c978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:38.643 7fad8623c978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:38.690 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-global-system-config', 'default-global-vrouter-config']: Unknown id: global_vrouter_config default-global-system-config:default-global-vrouter-config 06/02/2025 02:07:38.780 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain']: Unknown id: domain default-domain 06/02/2025 02:07:38.979 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-global-system-config', 'default-fabric']: Unknown id: fabric default-global-system-config:default-fabric 06/02/2025 02:07:39.027 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-policy-management']: Unknown id: policy_management default-policy-management 06/02/2025 02:07:39.080 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-policy-management', 'default-application-policy-set']: Unknown id: application_policy_set default-policy-management:default-application-policy-set 06/02/2025 02:07:39.177 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'ip-fabric']: Unknown id: virtual_network default-domain:default-project:ip-fabric 06/02/2025 02:07:39.242 7fad86916390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:39.315 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric']: Unknown id: routing_instance default-domain:default-project:ip-fabric:ip-fabric 06/02/2025 02:07:39.351 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'ip-fabric', '__default__']: Unknown id: routing_instance default-domain:default-project:ip-fabric:__default__ 06/02/2025 02:07:39.388 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', '__link_local__']: Unknown id: virtual_network default-domain:default-project:__link_local__ 06/02/2025 02:07:39.474 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', '__link_local__', '__link_local__']: Unknown id: routing_instance default-domain:default-project:__link_local__:__link_local__ 06/02/2025 02:07:39.509 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'dci-network']: Unknown id: virtual_network default-domain:default-project:dci-network 06/02/2025 02:07:39.598 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'dci-network', 'dci-network']: Unknown id: routing_instance default-domain:default-project:dci-network:dci-network 06/02/2025 02:07:39.671 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'dci-network', '__default__']: Unknown id: routing_instance default-domain:default-project:dci-network:__default__ 06/02/2025 02:07:39.717 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-global-system-config', 'system-defined-bottle-request-size-limit']: Unknown id: alarm default-global-system-config:system-defined-bottle-request-size-limit 06/02/2025 02:07:39.752 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network']: Unknown id: routing_instance default-domain:default-project:default-virtual-network:default-virtual-network 06/02/2025 02:07:39.787 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', '__no_rule__']: Unknown id: security_group default-domain:default-project:__no_rule__ 06/02/2025 02:07:39.834 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-discovery-service-assignment']: Unknown id: discovery_service_assignment default-discovery-service-assignment 06/02/2025 02:07:39.857 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-global-system-config', 'default-global-qos-config']: Unknown id: global_qos_config default-global-system-config:default-global-qos-config 06/02/2025 02:07:39.884 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'service-chain-flat-ipam']: Unknown id: network_ipam default-domain:default-project:service-chain-flat-ipam 06/02/2025 02:07:39.922 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['label']: Unknown id: tag_type label 06/02/2025 02:07:39.958 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['application']: Unknown id: tag_type application 06/02/2025 02:07:39.987 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['tier']: Unknown id: tag_type tier 06/02/2025 02:07:40.013 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['deployment']: Unknown id: tag_type deployment 06/02/2025 02:07:40.073 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['site']: Unknown id: tag_type site 06/02/2025 02:07:40.107 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['neutron_fwaas']: Unknown id: tag_type neutron_fwaas 06/02/2025 02:07:40.148 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['neutron_tag']: Unknown id: tag_type neutron_tag 06/02/2025 02:07:40.165 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Executing db_resync on api-server instance 10.0.0.129_0 06/02/2025 02:07:40.165 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Contrail Version is(nightly) 06/02/2025 02:07:40.202 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: zk_sync_node data (None) 06/02/2025 02:07:40.202 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DBERESYNC: running dbe-resync 06/02/2025 02:07:40.211 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type tag_type len 7 06/02/2025 02:07:40.211 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for tag_type 06/02/2025 02:07:40.228 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for tag_type 06/02/2025 02:07:40.229 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type network_ipam len 2 06/02/2025 02:07:40.229 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for network_ipam 06/02/2025 02:07:40.252 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for network_ipam 06/02/2025 02:07:40.253 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type global_system_config len 1 06/02/2025 02:07:40.253 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for global_system_config 06/02/2025 02:07:40.260 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Error in _create_default_rbac_rule: NoIdError: Unknown id: api_access_list default-global-system-config:default-api-access-list 06/02/2025 02:07:40.263 7fad8c3713c8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-global-system-config', 'default-api-access-list']: Unknown id: api_access_list default-global-system-config:default-api-access-list 06/02/2025 02:07:40.271 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for global_system_config 06/02/2025 02:07:40.271 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type routing_instance len 6 06/02/2025 02:07:40.271 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for routing_instance 06/02/2025 02:07:40.289 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for routing_instance 06/02/2025 02:07:40.289 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type domain len 1 06/02/2025 02:07:40.289 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for domain 06/02/2025 02:07:40.582 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Starting consumer greenlet 06/02/2025 02:07:40.582 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Ensuring Consumer connection 06/02/2025 02:07:40.583 7fad8571b630 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Starting publisher greenlet 06/02/2025 02:07:40.583 7fad8571b630 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Ensuring Publisher connection 06/02/2025 02:07:40.585 7fad8c3713c8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Added consumer: amqp_request.cn-jenkins-deploy-platform-juju-os-542-1.dummy 06/02/2025 02:07:40.585 7fad8c3713c8 [contrail-api] [DEBUG]: Add uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:07:40.618 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for domain 06/02/2025 02:07:40.618 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type security_group len 1 06/02/2025 02:07:40.619 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for security_group 06/02/2025 02:07:40.625 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for security_group 06/02/2025 02:07:40.625 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type alarm len 1 06/02/2025 02:07:40.625 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for alarm 06/02/2025 02:07:40.632 7fad8571b4e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 06/02/2025 02:07:40.633 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for alarm 06/02/2025 02:07:40.633 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type global_vrouter_config len 1 06/02/2025 02:07:40.633 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for global_vrouter_config 06/02/2025 02:07:40.636 7fad8571b630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Publisher connection established 06/02/2025 02:07:40.640 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for global_vrouter_config 06/02/2025 02:07:40.640 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type project len 1 06/02/2025 02:07:40.640 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for project 06/02/2025 02:07:40.647 7fad86ca4588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'default-application-policy-set']: Unknown id: application_policy_set default-domain:default-project:default-application-policy-set 06/02/2025 02:07:40.649 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-juju-os-542-1.dummy'] 06/02/2025 02:07:40.672 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Ensuring Consumer connection 06/02/2025 02:07:40.698 7fad8606e4e0 [contrail-api] [DEBUG]: Add uve in the [ObjectProjectTable:ContrailConfigTrace] map 06/02/2025 02:07:40.698 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for project 06/02/2025 02:07:40.698 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type virtual_network len 4 06/02/2025 02:07:40.699 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for virtual_network 06/02/2025 02:07:40.714 7fad8571b4e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 06/02/2025 02:07:40.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-juju-os-542-1.dummy'] 06/02/2025 02:07:40.767 7fad85fa6d68 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 06/02/2025 02:07:40.768 7fad85c64cc0 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 06/02/2025 02:07:40.768 7fad85c648d0 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 06/02/2025 02:07:40.769 7fad85c64b70 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 06/02/2025 02:07:40.769 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for virtual_network 06/02/2025 02:07:40.769 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type fabric len 1 06/02/2025 02:07:40.769 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for fabric 06/02/2025 02:07:40.773 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for fabric 06/02/2025 02:07:40.773 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type application_policy_set len 1 06/02/2025 02:07:40.773 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for application_policy_set 06/02/2025 02:07:40.782 7fad862674e0 [contrail-api] [DEBUG]: Add uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 06/02/2025 02:07:40.782 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for application_policy_set 06/02/2025 02:07:40.783 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type policy_management len 1 06/02/2025 02:07:40.783 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for policy_management 06/02/2025 02:07:40.786 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for policy_management 06/02/2025 02:07:40.787 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type global_qos_config len 1 06/02/2025 02:07:40.787 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for global_qos_config 06/02/2025 02:07:40.792 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for global_qos_config 06/02/2025 02:07:40.792 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type namespace len 1 06/02/2025 02:07:40.792 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for namespace 06/02/2025 02:07:40.799 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for namespace 06/02/2025 02:07:40.799 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type discovery_service_assignment len 1 06/02/2025 02:07:40.799 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for discovery_service_assignment 06/02/2025 02:07:40.802 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for discovery_service_assignment 06/02/2025 02:07:40.808 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DBERESYNC: Completed successfully 06/02/2025 02:07:40.812 7fad8606ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Cassandra DB walk completed. 06/02/2025 02:07:40.837 7fad8606ab70 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Time elapsed in resyncing db: 0:00:00.671314 06/02/2025 02:07:40.838 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config'], 'obj_dict': {'autonomous_system': 64512, 'config_version': '1.0', 'enable_4byte_as': False, 'enable_security_policy_draft': False, 'fq_name': ['default-global-system-config'], 'ibgp_auto_mesh': True, 'id_perms': {'created': '2025-06-02T02:07:38.664714', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:38.664714', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13061074979641842820, 'uuid_mslong': 4271052213156528773}}, 'igmp_enable': False, 'mac_aging_time': 300, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3b45d35b-de57-4285-b542-427e524b5c84'}, 'oper': 'CREATE', 'request-id': 'req-f3a81dcd-9dbe-4362-a211-ffd4597787b0', 'type': 'global_system_config', 'uuid': '3b45d35b-de57-4285-b542-427e524b5c84'} 06/02/2025 02:07:40.841 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'obj_dict': {'enable_security_logging': True, 'encryption_mode': 'none', 'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'id_perms': {'created': '2025-06-02T02:07:38.741110', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:38.741110', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9972017065538284403, 'uuid_mslong': 2787167015848723687}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '26ae01a2-4559-44e7-8a63-b8afe58aeb73'}, 'oper': 'CREATE', 'request-id': 'req-ae6e8cf7-8763-4614-8315-5a16c007d7b6', 'type': 'global_vrouter_config', 'uuid': '26ae01a2-4559-44e7-8a63-b8afe58aeb73'} 06/02/2025 02:07:40.842 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain'], 'obj_dict': {'fq_name': ['default-domain'], 'id_perms': {'created': '2025-06-02T02:07:38.801320', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:38.801320', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12002263489090238349, 'uuid_mslong': 2899704456855569170}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '283dd1d7-187e-4312-a690-9b0d77dd378d'}, 'oper': 'CREATE', 'request-id': 'req-4d3f15e8-19e9-47a1-ae62-5d52a6f180b4', 'type': 'domain', 'uuid': '283dd1d7-187e-4312-a690-9b0d77dd378d'} 06/02/2025 02:07:40.843 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'obj_dict': {'_enable_security_policy_draft': False, '_type': 'project', '_uuid': None, 'fq_name': ['default-domain', 'default-project'], 'id_perms': {'created': '2025-06-02T02:07:38.838504', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:38.838504', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11941414542463103012, 'uuid_mslong': 3547538508817449897}}, 'name': 'default-project', 'parent_type': 'domain', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '313b637a-6515-43a9-a5b8-6d420f327024'}, 'oper': 'CREATE', 'request-id': 'req-d73f1f5c-6db5-4580-b495-548b5001ea04', 'type': 'project', 'uuid': '313b637a-6515-43a9-a5b8-6d420f327024'} 06/02/2025 02:07:40.845 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'obj_dict': {'_type': 'network-ipam', '_uuid': None, 'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'id_perms': {'created': '2025-06-02T02:07:38.881857', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:38.881857', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13185347384803548857, 'uuid_mslong': 12277906467732800264}}, 'name': 'default-network-ipam', 'parent_type': 'project', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'aa63e2e1-9aaf-4308-b6fb-c39667575eb9'}, 'oper': 'CREATE', 'request-id': 'req-fc955eb4-5570-498c-a7c1-019d3b82fc15', 'type': 'network_ipam', 'uuid': 'aa63e2e1-9aaf-4308-b6fb-c39667575eb9'} 06/02/2025 02:07:40.847 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network'], 'obj_dict': {'_fabric_snat': False, '_flood_unknown_unicast': False, '_igmp_enable': False, '_is_provider_network': False, '_layer2_control_word': False, '_mac_aging_time': 300, '_mac_ip_learning_enable': False, '_mac_learning_enabled': False, '_pbb_etree_enable': False, '_pbb_evpn_enable': False, '_port_security_enabled': True, '_type': 'virtual-network', '_uuid': None, '_virtual_network_category': 'tenant', 'fq_name': ['default-domain', 'default-project', 'default-virtual-network'], 'id_perms': {'created': '2025-06-02T02:07:38.930862', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:38.930862', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12941292602126547315, 'uuid_mslong': 15267011952473687091}}, 'name': 'default-virtual-network', 'parent_type': 'project', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd3df527b-90d6-4433-b398-b50e4424b973', 'virtual_network_network_id': 1}, 'oper': 'CREATE', 'request-id': 'req-640302cf-ba6e-4f84-a7f5-d11051bb8283', 'type': 'virtual_network', 'uuid': 'd3df527b-90d6-4433-b398-b50e4424b973'} 06/02/2025 02:07:40.853 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-namespace'], 'obj_dict': {'_type': 'namespace', '_uuid': None, 'fq_name': ['default-domain', 'default-namespace'], 'id_perms': {'created': '2025-06-02T02:07:38.952831', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:38.952831', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11180165328256012172, 'uuid_mslong': 16815115262266198928}}, 'name': 'default-namespace', 'parent_type': 'domain', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e95b4a3d-a0a0-4b90-9b27-ed2188d68f8c'}, 'oper': 'CREATE', 'request-id': 'req-738c5c81-624a-4861-b23c-db3c840f2a51', 'type': 'namespace', 'uuid': 'e95b4a3d-a0a0-4b90-9b27-ed2188d68f8c'} 06/02/2025 02:07:40.855 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-fabric'], 'obj_dict': {'disable_vlan_vn_uniqueness_check': False, 'fabric_enterprise_style': True, 'fq_name': ['default-global-system-config', 'default-fabric'], 'id_perms': {'created': '2025-06-02T02:07:39.011166', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.011166', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11580122490806283395, 'uuid_mslong': 401927855744304897}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0593ef41-5af9-4701-a0b4-dc0d20052c83'}, 'oper': 'CREATE', 'request-id': 'req-a560730f-8cca-409c-a8f3-0a7d88dcb0f9', 'type': 'fabric', 'uuid': '0593ef41-5af9-4701-a0b4-dc0d20052c83'} 06/02/2025 02:07:40.856 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-policy-management'], 'obj_dict': {'fq_name': ['default-policy-management'], 'id_perms': {'created': '2025-06-02T02:07:39.046642', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.046642', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11354559130970438174, 'uuid_mslong': 6707768743718569153}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5d16c822-14d0-44c1-9d93-7f5edea93a1e'}, 'oper': 'CREATE', 'request-id': 'req-76dd5472-fc0d-40f2-a4fa-11da79998d57', 'type': 'policy_management', 'uuid': '5d16c822-14d0-44c1-9d93-7f5edea93a1e'} 06/02/2025 02:07:40.861 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'obj_dict': {'all_applications': True, 'fq_name': ['default-policy-management', 'default-application-policy-set'], 'id_perms': {'created': '2025-06-02T02:07:39.109254', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.109254', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12588796230361022454, 'uuid_mslong': 291032418762048174}}, 'parent_type': 'policy-management', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0409f471-626f-42ae-aeb4-63792471fff6'}, 'oper': 'CREATE', 'request-id': 'req-0cba0452-4e19-488f-930a-c85f4f3dbd9d', 'type': 'application_policy_set', 'uuid': '0409f471-626f-42ae-aeb4-63792471fff6'} 06/02/2025 02:07:40.864 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-f41019e4-eb81-4747-9d3f-8b74ef791f58', 'type': 'application_policy_set', 'uuid': '0409f471-626f-42ae-aeb4-63792471fff6'} 06/02/2025 02:07:40.869 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric'], 'obj_dict': {'fabric_snat': False, 'flood_unknown_unicast': False, 'fq_name': ['default-domain', 'default-project', 'ip-fabric'], 'id_perms': {'created': '2025-06-02T02:07:39.241267', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.241267', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10465735963771584814, 'uuid_mslong': 16366545616506667243}}, 'igmp_enable': False, 'is_provider_network': True, 'layer2_control_word': False, 'mac_aging_time': 300, 'mac_ip_learning_enable': False, 'mac_learning_enabled': False, 'parent_type': 'project', 'pbb_etree_enable': False, 'pbb_evpn_enable': False, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'port_security_enabled': True, 'uuid': 'e321a686-481b-40eb-913d-c368c1a2c12e', 'virtual_network_category': 'tenant', 'virtual_network_network_id': 2}, 'oper': 'CREATE', 'request-id': 'req-157264e6-9035-4539-ae08-9cafaeab054f', 'type': 'virtual_network', 'uuid': 'e321a686-481b-40eb-913d-c368c1a2c12e'} 06/02/2025 02:07:40.877 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'id_perms': {'created': '2025-06-02T02:07:39.340523', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.340523', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11656430626586816761, 'uuid_mslong': 4916171266963097643}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '4439bfb8-6651-482b-a1c3-f5e57eb0f0f9'}, 'oper': 'CREATE', 'request-id': 'req-cbb074ce-af0a-4083-b1d9-bb0db77e1855', 'type': 'routing_instance', 'uuid': '4439bfb8-6651-482b-a1c3-f5e57eb0f0f9'} 06/02/2025 02:07:40.881 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__'], 'id_perms': {'created': '2025-06-02T02:07:39.369186', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.369186', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11523214006377279719, 'uuid_mslong': 6752463304994144369}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': False, 'uuid': '5db59199-8d09-4071-9fea-ae1610ec70e7'}, 'oper': 'CREATE', 'request-id': 'req-39a0bf74-b623-4c00-90ec-d1ec66878959', 'type': 'routing_instance', 'uuid': '5db59199-8d09-4071-9fea-ae1610ec70e7'} 06/02/2025 02:07:40.883 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '__link_local__'], 'obj_dict': {'fabric_snat': False, 'flood_unknown_unicast': False, 'fq_name': ['default-domain', 'default-project', '__link_local__'], 'id_perms': {'created': '2025-06-02T02:07:39.416880', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.416880', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12265952371504274765, 'uuid_mslong': 16257347393596375814}}, 'igmp_enable': False, 'is_provider_network': False, 'layer2_control_word': False, 'mac_aging_time': 300, 'mac_ip_learning_enable': False, 'mac_learning_enabled': False, 'parent_type': 'project', 'pbb_etree_enable': False, 'pbb_evpn_enable': False, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'port_security_enabled': True, 'uuid': 'e19db351-c16f-4306-aa39-6ab1af5f5d4d', 'virtual_network_category': 'tenant', 'virtual_network_network_id': 3}, 'oper': 'CREATE', 'request-id': 'req-6557b4e4-bd56-4f7d-b92f-be739c8dfa37', 'type': 'virtual_network', 'uuid': 'e19db351-c16f-4306-aa39-6ab1af5f5d4d'} 06/02/2025 02:07:40.887 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '__link_local__', '__link_local__'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', '__link_local__', '__link_local__'], 'id_perms': {'created': '2025-06-02T02:07:39.498622', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.498622', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11878202269365588080, 'uuid_mslong': 1231046577497000833}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '11158e57-01ab-4b81-a4d7-da07d3c65070'}, 'oper': 'CREATE', 'request-id': 'req-8d1efb87-5956-4619-9b9a-1cbdb683d3ff', 'type': 'routing_instance', 'uuid': '11158e57-01ab-4b81-a4d7-da07d3c65070'} 06/02/2025 02:07:40.889 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network'], 'obj_dict': {'fabric_snat': False, 'flood_unknown_unicast': False, 'fq_name': ['default-domain', 'default-project', 'dci-network'], 'id_perms': {'created': '2025-06-02T02:07:39.539649', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.539649', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10815328664779595480, 'uuid_mslong': 5491571884461998138}}, 'igmp_enable': False, 'is_provider_network': False, 'layer2_control_word': False, 'mac_aging_time': 300, 'mac_ip_learning_enable': False, 'mac_learning_enabled': False, 'parent_type': 'project', 'pbb_etree_enable': False, 'pbb_evpn_enable': False, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'port_security_enabled': True, 'uuid': '4c35fb88-87e1-403a-9617-c41e59499ed8', 'virtual_network_category': 'tenant', 'virtual_network_network_id': 4}, 'oper': 'CREATE', 'request-id': 'req-4160a1be-77fe-4a8f-9c0a-f2ef765b5834', 'type': 'virtual_network', 'uuid': '4c35fb88-87e1-403a-9617-c41e59499ed8'} 06/02/2025 02:07:40.893 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'id_perms': {'created': '2025-06-02T02:07:39.621670', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.621670', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11697764289227362421, 'uuid_mslong': 2617771792912828508}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '24543193-7b9b-485c-a256-cea4c5a59075'}, 'oper': 'CREATE', 'request-id': 'req-abd72e11-3f07-4cf8-bade-6b22eeebe5d9', 'type': 'routing_instance', 'uuid': '24543193-7b9b-485c-a256-cea4c5a59075'} 06/02/2025 02:07:40.894 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'id_perms': {'created': '2025-06-02T02:07:39.706174', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.706174', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10056472831816996375, 'uuid_mslong': 13229314182527405371}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': False, 'uuid': 'b797f728-3795-4d3b-8b8f-c4c251d19617'}, 'oper': 'CREATE', 'request-id': 'req-e66725f7-90a1-4aa5-ad8f-f43ac3dba6b2', 'type': 'routing_instance', 'uuid': 'b797f728-3795-4d3b-8b8f-c4c251d19617'} 06/02/2025 02:07:40.896 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bottle-request-size-limit'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'UveConfigReq.err_info.*.', 'operand2': {'json_value': 'True'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'fq_name': ['default-global-system-config', 'system-defined-bottle-request-size-limit'], 'id_perms': {'created': '2025-06-02T02:07:39.735259', 'description': 'Bottle request size limit exceeded.', 'last_modified': '2025-06-02T02:07:39.735259', 'uuid': {'uuid_lslong': 10710134202661605791, 'uuid_mslong': 427423515783155221}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '05ee836c-4ae7-4e15-94a2-0a500668119f', 'uve_keys': {'uve_key': ['config-node']}}, 'oper': 'CREATE', 'request-id': 'req-9c1505f8-01f7-40f4-904d-9b7659bd25da', 'type': 'alarm', 'uuid': '05ee836c-4ae7-4e15-94a2-0a500668119f'} 06/02/2025 02:07:40.897 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'id_perms': {'created': '2025-06-02T02:07:39.777984', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.777984', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13130958845553712458, 'uuid_mslong': 4761588035728982736}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '42148f17-2c60-42d0-b63a-897fcd809d4a'}, 'oper': 'CREATE', 'request-id': 'req-edc6abae-d38d-4145-a487-fc12f68f32cd', 'type': 'routing_instance', 'uuid': '42148f17-2c60-42d0-b63a-897fcd809d4a'} 06/02/2025 02:07:40.898 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__'], 'obj_dict': {'configured_security_group_id': 0, 'fq_name': ['default-domain', 'default-project', '__no_rule__'], 'id_perms': {'created': '2025-06-02T02:07:39.822277', 'creator': None, 'description': 'Security group with no rules', 'enable': True, 'last_modified': '2025-06-02T02:07:39.822277', 'permissions': None, 'user_visible': True, 'uuid': {'uuid_lslong': 10472820687575029612, 'uuid_mslong': 9479700564681179665}}, 'parent_type': 'project', 'perms2': {'global_access': 5, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': []}, 'security_group_id': 8000001, 'uuid': '838ea970-1ee4-4211-9156-eeed8f45976c'}, 'oper': 'CREATE', 'request-id': 'req-27913859-76b0-4ce8-8996-e8e87d494c85', 'type': 'security_group', 'uuid': '838ea970-1ee4-4211-9156-eeed8f45976c'} 06/02/2025 02:07:40.901 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-discovery-service-assignment'], 'obj_dict': {'fq_name': ['default-discovery-service-assignment'], 'id_perms': {'created': '2025-06-02T02:07:39.849089', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.849089', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9374675936287564634, 'uuid_mslong': 11392748457311489827}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9e1b2c5c-4d6e-4f23-8219-8a184ad2a35a'}, 'oper': 'CREATE', 'request-id': 'req-127fddb7-7972-4acc-bcc7-c1ecbe4b683b', 'type': 'discovery_service_assignment', 'uuid': '9e1b2c5c-4d6e-4f23-8219-8a184ad2a35a'} 06/02/2025 02:07:40.902 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-qos-config'], 'obj_dict': {'fq_name': ['default-global-system-config', 'default-global-qos-config'], 'id_perms': {'created': '2025-06-02T02:07:39.874280', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.874280', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9651207274978570674, 'uuid_mslong': 4106217634641363202}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '38fc372e-db3e-4102-85ef-f9e1dec371b2'}, 'oper': 'CREATE', 'request-id': 'req-21e5a616-4d27-4f5f-9b02-6b39f1039a4c', 'type': 'global_qos_config', 'uuid': '38fc372e-db3e-4102-85ef-f9e1dec371b2'} 06/02/2025 02:07:40.904 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'service-chain-flat-ipam'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'service-chain-flat-ipam'], 'id_perms': {'created': '2025-06-02T02:07:39.913496', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.913496', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10284657313715403400, 'uuid_mslong': 13389064529163340191}}, 'ipam_subnet_method': 'flat-subnet', 'ipam_subnets': {'subnets': [{'addr_from_start': None, 'alloc_unit': 1, 'allocation_pools': [], 'created': None, 'default_gateway': None, 'dhcp_option_list': None, 'dhcp_relay_server': [], 'dns_nameservers': [], 'dns_server_address': None, 'enable_dhcp': True, 'host_routes': None, 'last_modified': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 8}, 'subnet_name': None, 'subnet_uuid': None, 'subscriber_tag': None, 'vlan_tag': None}, {'addr_from_start': None, 'alloc_unit': 1, 'allocation_pools': [], 'created': None, 'default_gateway': None, 'dhcp_option_list': None, 'dhcp_relay_server': [], 'dns_nameservers': [], 'dns_server_address': None, 'enable_dhcp': True, 'host_routes': None, 'last_modified': None, 'subnet': {'ip_prefix': '::ffff', 'ip_prefix_len': 104}, 'subnet_name': None, 'subnet_uuid': None, 'subscriber_tag': None, 'vlan_tag': None}]}, 'parent_type': 'project', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b9cf8340-3f90-499f-8eba-71561ca13a88'}, 'oper': 'CREATE', 'request-id': 'req-cff9d620-cc16-4f4e-ac82-890e7b091cf7', 'type': 'network_ipam', 'uuid': 'b9cf8340-3f90-499f-8eba-71561ca13a88'} 06/02/2025 02:07:40.927 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label'], 'obj_dict': {'display_name': 'label', 'fq_name': ['label'], 'id_perms': {'created': '2025-06-02T02:07:39.949895', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.949895', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 12696144219202709233, 'uuid_mslong': 1374105341540125198}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0000', 'uuid': '1311cd87-1e77-4a0e-b031-c3e67ab4e6f1'}, 'oper': 'CREATE', 'request-id': 'req-db450230-3a11-4fda-8957-f50446a64445', 'type': 'tag_type', 'uuid': '1311cd87-1e77-4a0e-b031-c3e67ab4e6f1'} 06/02/2025 02:07:40.933 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['application'], 'obj_dict': {'display_name': 'application', 'fq_name': ['application'], 'id_perms': {'created': '2025-06-02T02:07:39.976455', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:39.976455', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 10555492496157507062, 'uuid_mslong': 7085153163103193615}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0001', 'uuid': '62538543-5a00-4a0f-927c-a47ff6c4fdf6'}, 'oper': 'CREATE', 'request-id': 'req-d8333425-cde0-4929-80b4-75a60fc0fce0', 'type': 'tag_type', 'uuid': '62538543-5a00-4a0f-927c-a47ff6c4fdf6'} 06/02/2025 02:07:40.938 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['tier'], 'obj_dict': {'display_name': 'tier', 'fq_name': ['tier'], 'id_perms': {'created': '2025-06-02T02:07:40.005077', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:40.005077', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 13082707732862832528, 'uuid_mslong': 5917144912874391396}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0002', 'uuid': '521debf2-a863-4764-b58f-1d5e2d8b8f90'}, 'oper': 'CREATE', 'request-id': 'req-8312bb1c-5b1d-4d55-a94e-74d1646bae49', 'type': 'tag_type', 'uuid': '521debf2-a863-4764-b58f-1d5e2d8b8f90'} 06/02/2025 02:07:40.942 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['deployment'], 'obj_dict': {'display_name': 'deployment', 'fq_name': ['deployment'], 'id_perms': {'created': '2025-06-02T02:07:40.040530', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:40.040530', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 10818282115219943940, 'uuid_mslong': 8315078416481339721}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0003', 'uuid': '736517c3-bde3-4949-9622-42441da57204'}, 'oper': 'CREATE', 'request-id': 'req-edc767b5-4734-4519-b730-67ea69eabe7a', 'type': 'tag_type', 'uuid': '736517c3-bde3-4949-9622-42441da57204'} 06/02/2025 02:07:40.945 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['site'], 'obj_dict': {'display_name': 'site', 'fq_name': ['site'], 'id_perms': {'created': '2025-06-02T02:07:40.094168', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:40.094168', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 10912069964026426454, 'uuid_mslong': 11805038817196330258}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0004', 'uuid': 'a3d3ec42-2aaf-4d12-976f-75d152013456'}, 'oper': 'CREATE', 'request-id': 'req-c9e53296-06a5-4530-afa2-fa83fd45e1ea', 'type': 'tag_type', 'uuid': 'a3d3ec42-2aaf-4d12-976f-75d152013456'} 06/02/2025 02:07:40.948 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['neutron_fwaas'], 'obj_dict': {'display_name': 'neutron_fwaas', 'fq_name': ['neutron_fwaas'], 'id_perms': {'created': '2025-06-02T02:07:40.125291', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:40.125291', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 12115643491532548038, 'uuid_mslong': 1214716214148615957}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0005', 'uuid': '10db89f5-ff3c-4f15-a823-69906a1227c6'}, 'oper': 'CREATE', 'request-id': 'req-5625c924-9f45-4d0a-9c0d-39849fae38fe', 'type': 'tag_type', 'uuid': '10db89f5-ff3c-4f15-a823-69906a1227c6'} 06/02/2025 02:07:40.951 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['neutron_tag'], 'obj_dict': {'display_name': 'neutron_tag', 'fq_name': ['neutron_tag'], 'id_perms': {'created': '2025-06-02T02:07:40.160827', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:40.160827', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 9624673835547897143, 'uuid_mslong': 5676030960955706513}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0006', 'uuid': '4ec55016-09e2-4c91-8591-b5dc16d42d37'}, 'oper': 'CREATE', 'request-id': 'req-eae35e1f-485a-4da4-a1b9-cd16b83d31e1', 'type': 'tag_type', 'uuid': '4ec55016-09e2-4c91-8591-b5dc16d42d37'} 06/02/2025 02:07:40.953 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-d2ae4aa2-9004-437e-bc2a-0a493f5d10bc', 'type': 'network_ipam', 'uuid': 'aa63e2e1-9aaf-4308-b6fb-c39667575eb9'} 06/02/2025 02:07:40.960 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-api-access-list'], 'obj_dict': {'api_access_list_entries': {'rbac_rule': [{'rule_field': '', 'rule_object': 'fqname-to-id', 'rule_perms': [{'role_crud': 'CRUD', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': 'id-to-fqname', 'rule_perms': [{'role_crud': 'CRUD', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': 'useragent-kv', 'rule_perms': [{'role_crud': 'CRUD', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': 'documentation', 'rule_perms': [{'role_crud': 'R', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': '/', 'rule_perms': [{'role_crud': 'R', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': 'watch', 'rule_perms': [{'role_crud': 'R', 'role_name': '*'}]}, {'rule_field': 'logical_router_gateway_external', 'rule_object': 'logical-router', 'rule_perms': [{'role_crud': 'R', 'role_name': '*'}]}]}, 'fq_name': ['default-global-system-config', 'default-api-access-list'], 'id_perms': {'created': '2025-06-02T02:07:40.288724', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:40.288724', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13655003994244755354, 'uuid_mslong': 8628853906201397062}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '77bfd8e8-f9e0-4746-bd80-51c9137faf9a'}, 'oper': 'CREATE', 'request-id': 'req-3a062ee4-5b09-4c47-b0b1-c2e2f293015c', 'type': 'api_access_list', 'uuid': '77bfd8e8-f9e0-4746-bd80-51c9137faf9a'} 06/02/2025 02:07:40.962 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-application-policy-set'], 'obj_dict': {'all_applications': True, 'fq_name': ['default-domain', 'default-project', 'default-application-policy-set'], 'id_perms': {'created': '2025-06-02T02:07:40.667446', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:40.667446', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12597980142772293036, 'uuid_mslong': 11475883316388380805}}, 'parent_type': 'project', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9f428713-0d29-4085-aed5-0431615e0dac'}, 'oper': 'CREATE', 'request-id': 'req-f09ce4a6-92cb-4520-875e-80f5652c3872', 'type': 'application_policy_set', 'uuid': '9f428713-0d29-4085-aed5-0431615e0dac'} 06/02/2025 02:07:40.962 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 06/02/2025 02:07:40.963 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-07d948c2-73d6-4e8c-97c8-db7c40450443', 'type': 'project', 'uuid': '313b637a-6515-43a9-a5b8-6d420f327024'} 06/02/2025 02:07:41.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:42.210 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 06/02/2025 02:07:42.210 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 06/02/2025 02:07:42.210 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 06/02/2025 02:07:42.211 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 06/02/2025 02:07:42.211 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 06/02/2025 02:07:42.211 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 06/02/2025 02:07:42.211 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 06/02/2025 02:07:42.211 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 06/02/2025 02:07:42.211 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 06/02/2025 02:07:42.211 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 06/02/2025 02:07:42.211 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 06/02/2025 02:07:42.212 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 06/02/2025 02:07:42.212 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 06/02/2025 02:07:42.215 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 06/02/2025 02:07:42.215 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 06/02/2025 02:07:42.216 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 06/02/2025 02:07:42.216 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 06/02/2025 02:07:42.216 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 06/02/2025 02:07:42.216 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 06/02/2025 02:07:42.216 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 06/02/2025 02:07:42.218 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 06/02/2025 02:07:42.218 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 06/02/2025 02:07:42.218 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 06/02/2025 02:07:42.218 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 06/02/2025 02:07:42.218 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 06/02/2025 02:07:42.218 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 06/02/2025 02:07:42.218 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 06/02/2025 02:07:42.218 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 06/02/2025 02:07:42.220 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 06/02/2025 02:07:42.220 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 06/02/2025 02:07:42.222 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 06/02/2025 02:07:42.222 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 06/02/2025 02:07:42.222 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource global-system-config: 'bgp_router_refs' 06/02/2025 02:07:42.222 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 06/02/2025 02:07:42.222 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 06/02/2025 02:07:42.343 7fad861a1390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'] not found in DB: Unknown id: database_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 06/02/2025 02:07:42.354 7fad86c81390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.129 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.129", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:42.354 7fad86c81390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.129 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.129", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:42.451 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'obj_dict': {'database_node_ip_address': '10.0.0.129', 'display_name': 'cn-jenkins-deploy-platform-juju-os-542-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'id_perms': {'created': '2025-06-02T02:07:42.421247', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:42.421247', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9609144780282056865, 'uuid_mslong': 2177284630240772820}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1e3744d5-e06b-42d4-855a-8a442802d0a1'}, 'oper': 'CREATE', 'request-id': 'req-cd8c8cfc-6a08-44f6-b134-29ba3e5277cb', 'type': 'database_node', 'uuid': '1e3744d5-e06b-42d4-855a-8a442802d0a1'} 06/02/2025 02:07:42.452 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 06/02/2025 02:07:42.547 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'image_upgrade_template'] not found in DB: Unknown id: job_template default-global-system-config:image_upgrade_template 06/02/2025 02:07:42.567 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_routers in resource routing-instance: 'bgp_routers' 06/02/2025 02:07:42.567 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_refs in resource routing-instance: 'routing_instance_refs' 06/02/2025 02:07:42.567 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_target_refs in resource routing-instance: 'route_target_refs' 06/02/2025 02:07:42.567 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource routing-instance: 'tag_refs' 06/02/2025 02:07:42.568 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource routing-instance: 'virtual_machine_interface_back_refs' 06/02/2025 02:07:42.568 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_aggregate_back_refs in resource routing-instance: 'route_aggregate_back_refs' 06/02/2025 02:07:42.568 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_back_refs in resource routing-instance: 'routing_policy_back_refs' 06/02/2025 02:07:42.568 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_back_refs in resource routing-instance: 'routing_instance_back_refs' 06/02/2025 02:07:42.578 7fad8582d780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:image_upgrade_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "image_upgrade_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/image_upgrade.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Image upgrade input\", \"type\": \"object\", \"properties\": {\"image_uuid\": {\"type\": \"string\"}}, \"required\": [\"image_uuid\"]}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Image Upgrade", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:42.579 7fad8582d780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:image_upgrade_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "image_upgrade_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/image_upgrade.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Image upgrade input\", \"type\": \"object\", \"properties\": {\"image_uuid\": {\"type\": \"string\"}}, \"required\": [\"image_uuid\"]}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Image Upgrade", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:42.642 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-juju-os-542-1'] not found in DB: Unknown id: bgp_router default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-542-1 06/02/2025 02:07:42.711 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'image_upgrade_template'], 'obj_dict': {'display_name': 'Image Upgrade', 'fq_name': ['default-global-system-config', 'image_upgrade_template'], 'id_perms': {'created': '2025-06-02T02:07:42.603031', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:42.603031', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10307467101482734498, 'uuid_mslong': 6906554731028630004}}, 'job_template_concurrency_level': 'device', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Image upgrade input", ' '"type": "object", "properties": ' '{"image_uuid": {"type": ' '"string"}}, "required": ' '["image_uuid"]}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/image_upgrade.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5fd902ef-74c1-49f4-8f0b-7ab7ade753a2'}, 'oper': 'CREATE', 'request-id': 'req-859f97c5-0363-4052-9285-6c0f3a5505d4', 'type': 'job_template', 'uuid': '5fd902ef-74c1-49f4-8f0b-7ab7ade753a2'} 06/02/2025 02:07:42.722 7fad85811780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.129 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.0.0.129", "address": "10.0.0.129", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:42.723 7fad85811780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.129 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.0.0.129", "address": "10.0.0.129", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:42.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:42.786 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 06/02/2025 02:07:42.786 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 06/02/2025 02:07:42.786 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 06/02/2025 02:07:42.786 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 06/02/2025 02:07:42.786 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 06/02/2025 02:07:42.786 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 06/02/2025 02:07:42.786 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 06/02/2025 02:07:42.786 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 06/02/2025 02:07:42.787 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 06/02/2025 02:07:42.787 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 06/02/2025 02:07:42.787 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 06/02/2025 02:07:42.787 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 06/02/2025 02:07:42.787 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 06/02/2025 02:07:42.787 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 06/02/2025 02:07:42.787 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 06/02/2025 02:07:42.787 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 06/02/2025 02:07:42.787 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 06/02/2025 02:07:42.787 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 06/02/2025 02:07:42.787 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 06/02/2025 02:07:42.787 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 06/02/2025 02:07:42.787 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 06/02/2025 02:07:42.788 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 06/02/2025 02:07:42.788 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 06/02/2025 02:07:42.788 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 06/02/2025 02:07:42.788 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 06/02/2025 02:07:42.788 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 06/02/2025 02:07:42.788 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 06/02/2025 02:07:42.788 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 06/02/2025 02:07:42.788 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 06/02/2025 02:07:42.788 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 06/02/2025 02:07:42.789 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 06/02/2025 02:07:42.789 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 06/02/2025 02:07:42.789 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource global-system-config: 'bgp_router_refs' 06/02/2025 02:07:42.789 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 06/02/2025 02:07:42.789 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 06/02/2025 02:07:42.846 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'obj_dict': {'bgp_router_parameters': {'address': '10.0.0.129', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.0.0.129', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-juju-os-542-1', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'id_perms': {'created': '2025-06-02T02:07:42.809933', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:42.809933', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13300429569056233772, 'uuid_mslong': 1264630939244251380}}, 'parent_type': 'routing-instance', 'parent_uuid': '5db59199-8d09-4071-9fea-ae1610ec70e7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '118cdf23-919f-48f4-b894-9e396fb2d92c'}, 'oper': 'CREATE', 'request-id': 'req-9c82e1ee-e0b9-4f41-bba7-7141bd12790d', 'type': 'bgp_router', 'uuid': '118cdf23-919f-48f4-b894-9e396fb2d92c'} 06/02/2025 02:07:42.849 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 06/02/2025 02:07:42.876 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'container_cleanup_template'] not found in DB: Unknown id: job_template default-global-system-config:container_cleanup_template 06/02/2025 02:07:42.924 7fad85834390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:container_cleanup_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "container_cleanup_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/container_cleanup.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Container cleanup input\", \"type\": \"object\", \"required\": [\"fabric_fq_name\", \"container_name\"], \"properties\": {\"container_name\": {\"type\": \"string\"}, \"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Container cleanup output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Container Cleanup", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:42.925 7fad85834390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:container_cleanup_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "container_cleanup_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/container_cleanup.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Container cleanup input\", \"type\": \"object\", \"required\": [\"fabric_fq_name\", \"container_name\"], \"properties\": {\"container_name\": {\"type\": \"string\"}, \"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Container cleanup output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Container Cleanup", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:42.925 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zone_refs in resource bgp-router: 'control_node_zone_refs' 06/02/2025 02:07:42.926 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource bgp-router: 'sub_cluster_refs' 06/02/2025 02:07:42.926 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource bgp-router: 'bgp_router_refs' 06/02/2025 02:07:42.926 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource bgp-router: 'tag_refs' 06/02/2025 02:07:42.926 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_system_config_back_refs in resource bgp-router: 'global_system_config_back_refs' 06/02/2025 02:07:42.926 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource bgp-router: 'physical_router_back_refs' 06/02/2025 02:07:42.926 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource bgp-router: 'virtual_machine_interface_back_refs' 06/02/2025 02:07:42.926 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_as_a_service_back_refs in resource bgp-router: 'bgp_as_a_service_back_refs' 06/02/2025 02:07:42.927 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_back_refs in resource bgp-router: 'bgp_router_back_refs' 06/02/2025 02:07:42.947 7fad85c486d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'] not found in DB: Unknown id: analytics_alarm_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 06/02/2025 02:07:43.009 7fad855c98d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.129 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.129", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.009 7fad855c98d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.129 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.129", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.025 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'container_cleanup_template'], 'obj_dict': {'display_name': 'Container Cleanup', 'fq_name': ['default-global-system-config', 'container_cleanup_template'], 'id_perms': {'created': '2025-06-02T02:07:42.955703', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:42.955703', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10390088985267089747, 'uuid_mslong': 14846881183024103561}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Container cleanup ' 'input", "type": "object", ' '"required": ["fabric_fq_name", ' '"container_name"], "properties": ' '{"container_name": {"type": ' '"string"}, "fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Container cleanup ' 'output", "type": "object", ' '"properties": {"status": {"type": ' '"string", "enum": ["Success", ' '"Failure", "Timeout"], ' '"description": "Result status of ' 'the job"}, "message": {"type": ' '"string", "description": "Should ' 'capture a summarized error ' 'message in case of Failures."}, ' '"results": {"type": "object", ' '"description": "JSON object ' 'holding the job specific output ' 'details"}}, "required": ' '["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/container_cleanup.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ce0ab7c6-1895-4089-9031-02e20f8b3153'}, 'oper': 'CREATE', 'request-id': 'req-da7a9bb2-9671-4a18-9360-07649c255c2d', 'type': 'job_template', 'uuid': 'ce0ab7c6-1895-4089-9031-02e20f8b3153'} 06/02/2025 02:07:43.059 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 06/02/2025 02:07:43.060 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 06/02/2025 02:07:43.060 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 06/02/2025 02:07:43.060 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 06/02/2025 02:07:43.060 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 06/02/2025 02:07:43.060 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 06/02/2025 02:07:43.060 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 06/02/2025 02:07:43.060 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 06/02/2025 02:07:43.060 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 06/02/2025 02:07:43.060 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 06/02/2025 02:07:43.061 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 06/02/2025 02:07:43.061 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 06/02/2025 02:07:43.061 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 06/02/2025 02:07:43.061 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 06/02/2025 02:07:43.061 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 06/02/2025 02:07:43.061 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 06/02/2025 02:07:43.061 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 06/02/2025 02:07:43.061 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 06/02/2025 02:07:43.061 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 06/02/2025 02:07:43.061 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 06/02/2025 02:07:43.061 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 06/02/2025 02:07:43.061 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 06/02/2025 02:07:43.061 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 06/02/2025 02:07:43.062 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 06/02/2025 02:07:43.062 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 06/02/2025 02:07:43.062 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 06/02/2025 02:07:43.062 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 06/02/2025 02:07:43.062 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 06/02/2025 02:07:43.062 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 06/02/2025 02:07:43.062 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 06/02/2025 02:07:43.062 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 06/02/2025 02:07:43.063 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 06/02/2025 02:07:43.063 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource global-system-config: 'bgp_router_refs' 06/02/2025 02:07:43.063 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 06/02/2025 02:07:43.063 7fad855ee198 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 06/02/2025 02:07:43.094 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.129', 'display_name': 'cn-jenkins-deploy-platform-juju-os-542-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'id_perms': {'created': '2025-06-02T02:07:43.085708', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:43.085708', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12631785540092545688, 'uuid_mslong': 5010956081159489659}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '458a7e01-b298-487b-af4d-1e05cc21ca98'}, 'oper': 'CREATE', 'request-id': 'req-390d2b33-8e99-42de-874e-0147a147c378', 'type': 'analytics_alarm_node', 'uuid': '458a7e01-b298-487b-af4d-1e05cc21ca98'} 06/02/2025 02:07:43.095 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 06/02/2025 02:07:43.129 7fad85564438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3b45d35b-de57-4285-b542-427e524b5c84 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.129:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.129 body = {"uuid": "3b45d35b-de57-4285-b542-427e524b5c84", "ref-uuid": "118cdf23-919f-48f4-b894-9e396fb2d92c"} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.130 7fad85564438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3b45d35b-de57-4285-b542-427e524b5c84 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.129:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.129 body = {"uuid": "3b45d35b-de57-4285-b542-427e524b5c84", "ref-uuid": "118cdf23-919f-48f4-b894-9e396fb2d92c"} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.147 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cli_sync_template'] not found in DB: Unknown id: job_template default-global-system-config:cli_sync_template 06/02/2025 02:07:43.158 7fad8555a240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:cli_sync_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "cli_sync_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/cli_sync.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"CLI sync input\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"devices_cli\": {\"type\": \"array\", \"items\": {\"title\": \"Devices CLI Items\", \"type\": \"object\", \"description\": \"Dictionaries of device details\", \"additionalProperties\": false, \"required\": [\"device_uuid\", \"cli_objects\"], \"properties\": {\"device_uuid\": {\"type\": \"string\", \"title\": \"UUIDs of the device\"}, \"cli_objects\": {\"type\": \"array\", \"title\": \"cli objects for that device\", \"items\": {\"type\": \"object\", \"required\": [\"time\", \"status\"], \"properties\": {\"time\": {\"type\": \"string\", \"title\": \"Timestamp of the cli change\"}, \"status\": {\"type\": \"string\", \"title\": \"Accept or Reject the commit\"}}}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Sync cli config with Contrail", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.158 7fad8555a240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:cli_sync_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "cli_sync_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/cli_sync.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"CLI sync input\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"devices_cli\": {\"type\": \"array\", \"items\": {\"title\": \"Devices CLI Items\", \"type\": \"object\", \"description\": \"Dictionaries of device details\", \"additionalProperties\": false, \"required\": [\"device_uuid\", \"cli_objects\"], \"properties\": {\"device_uuid\": {\"type\": \"string\", \"title\": \"UUIDs of the device\"}, \"cli_objects\": {\"type\": \"array\", \"title\": \"cli objects for that device\", \"items\": {\"type\": \"object\", \"required\": [\"time\", \"status\"], \"properties\": {\"time\": {\"type\": \"string\", \"title\": \"Timestamp of the cli change\"}, \"status\": {\"type\": \"string\", \"title\": \"Accept or Reject the commit\"}}}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Sync cli config with Contrail", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.179 7fad85821b70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3b45d35b-de57-4285-b542-427e524b5c84 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.129 body = {"type": "global-system-config", "uuid": "3b45d35b-de57-4285-b542-427e524b5c84", "ref-type": "bgp-router", "ref-uuid": "118cdf23-919f-48f4-b894-9e396fb2d92c", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-juju-os-542-1"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.180 7fad85821b70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3b45d35b-de57-4285-b542-427e524b5c84 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.129 body = {"type": "global-system-config", "uuid": "3b45d35b-de57-4285-b542-427e524b5c84", "ref-type": "bgp-router", "ref-uuid": "118cdf23-919f-48f4-b894-9e396fb2d92c", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-juju-os-542-1"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.196 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cli_sync_template'], 'obj_dict': {'display_name': 'Sync cli config with Contrail', 'fq_name': ['default-global-system-config', 'cli_sync_template'], 'id_perms': {'created': '2025-06-02T02:07:43.174669', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:43.174669', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10150646793481203178, 'uuid_mslong': 5145350397230661891}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "CLI sync input", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"type": "string", "description": ' '"Fabric UUID"}, "devices_cli": ' '{"type": "array", "items": ' '{"title": "Devices CLI Items", ' '"type": "object", "description": ' '"Dictionaries of device details", ' '"additionalProperties": false, ' '"required": ["device_uuid", ' '"cli_objects"], "properties": ' '{"device_uuid": {"type": "string", ' '"title": "UUIDs of the device"}, ' '"cli_objects": {"type": "array", ' '"title": "cli objects for that ' 'device", "items": {"type": ' '"object", "required": ["time", ' '"status"], "properties": {"time": ' '{"type": "string", "title": ' '"Timestamp of the cli change"}, ' '"status": {"type": "string", ' '"title": "Accept or Reject the ' 'commit"}}}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/cli_sync.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4767f4ec-cfd9-4103-8cde-577a6de7adea'}, 'oper': 'CREATE', 'request-id': 'req-bf0ef5c3-e235-419e-9456-56b333784933', 'type': 'job_template', 'uuid': '4767f4ec-cfd9-4103-8cde-577a6de7adea'} 06/02/2025 02:07:43.217 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-1b264eb2-50f2-4a4e-8425-da637932d759', 'type': 'global_system_config', 'uuid': '3b45d35b-de57-4285-b542-427e524b5c84'} 06/02/2025 02:07:43.295 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'hitless_upgrade_strategy_template'] not found in DB: Unknown id: job_template default-global-system-config:hitless_upgrade_strategy_template 06/02/2025 02:07:43.312 7fad854b9f60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:hitless_upgrade_strategy_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "hitless_upgrade_strategy_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hitless_upgrade_strategy.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hitless_upgrade.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 90, "sequence_no": 1}]}, "job_template_input_schema": "{\"title\": \"Image upgrade strategy input\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"upgrade_mode\": {\"enum\": [\"test_run\", \"dry_run\", \"upgrade\"], \"description\": \"Mode in which to run workflow\"}, \"device_list\": {\"type\": \"array\", \"description\": \"List of device UUIDs to be upgraded\", \"items\": {\"title\": \"device uuid\", \"type\": \"string\", \"format\": \"uuid\"}}, \"image_devices\": {\"type\": \"array\", \"items\": {\"title\": \"Image Devices\", \"type\": \"object\", \"description\": \"List of images and corresponding devices to upgrade\", \"additionalProperties\": false, \"properties\": {\"image_uuid\": {\"type\": \"string\"}, \"device_list\": {\"type\": \"array\", \"description\": \"List of device UUIDs to be upgraded with this image\", \"items\": {\"title\": \"device uuid\", \"type\": \"string\", \"format\": \"uuid\"}}}, \"required\": [\"image_uuid\", \"device_list\"]}}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable local interface down check\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable peer interface down check\", \"default\": true}}}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Hitless Image Upgrade", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.312 7fad854b9f60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:hitless_upgrade_strategy_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "hitless_upgrade_strategy_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hitless_upgrade_strategy.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hitless_upgrade.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 90, "sequence_no": 1}]}, "job_template_input_schema": "{\"title\": \"Image upgrade strategy input\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"upgrade_mode\": {\"enum\": [\"test_run\", \"dry_run\", \"upgrade\"], \"description\": \"Mode in which to run workflow\"}, \"device_list\": {\"type\": \"array\", \"description\": \"List of device UUIDs to be upgraded\", \"items\": {\"title\": \"device uuid\", \"type\": \"string\", \"format\": \"uuid\"}}, \"image_devices\": {\"type\": \"array\", \"items\": {\"title\": \"Image Devices\", \"type\": \"object\", \"description\": \"List of images and corresponding devices to upgrade\", \"additionalProperties\": false, \"properties\": {\"image_uuid\": {\"type\": \"string\"}, \"device_list\": {\"type\": \"array\", \"description\": \"List of device UUIDs to be upgraded with this image\", \"items\": {\"title\": \"device uuid\", \"type\": \"string\", \"format\": \"uuid\"}}}, \"required\": [\"image_uuid\", \"device_list\"]}}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable local interface down check\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable peer interface down check\", \"default\": true}}}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Hitless Image Upgrade", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.461 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 06/02/2025 02:07:43.462 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 06/02/2025 02:07:43.462 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 06/02/2025 02:07:43.462 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 06/02/2025 02:07:43.462 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 06/02/2025 02:07:43.462 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 06/02/2025 02:07:43.462 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 06/02/2025 02:07:43.462 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 06/02/2025 02:07:43.462 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 06/02/2025 02:07:43.462 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 06/02/2025 02:07:43.462 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 06/02/2025 02:07:43.462 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 06/02/2025 02:07:43.463 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 06/02/2025 02:07:43.463 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 06/02/2025 02:07:43.463 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 06/02/2025 02:07:43.463 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 06/02/2025 02:07:43.463 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 06/02/2025 02:07:43.463 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 06/02/2025 02:07:43.463 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 06/02/2025 02:07:43.463 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 06/02/2025 02:07:43.463 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 06/02/2025 02:07:43.463 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 06/02/2025 02:07:43.463 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 06/02/2025 02:07:43.464 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 06/02/2025 02:07:43.464 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 06/02/2025 02:07:43.464 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 06/02/2025 02:07:43.464 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 06/02/2025 02:07:43.464 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 06/02/2025 02:07:43.464 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 06/02/2025 02:07:43.464 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 06/02/2025 02:07:43.465 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 06/02/2025 02:07:43.465 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 06/02/2025 02:07:43.465 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 06/02/2025 02:07:43.465 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 06/02/2025 02:07:43.493 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'hitless_upgrade_strategy_template'], 'obj_dict': {'display_name': 'Hitless Image Upgrade', 'fq_name': ['default-global-system-config', 'hitless_upgrade_strategy_template'], 'id_perms': {'created': '2025-06-02T02:07:43.340623', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:43.340623', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11561405534261774061, 'uuid_mslong': 3320458644425886912}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "Image upgrade strategy ' 'input", "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"type": "string", "description": ' '"Fabric UUID"}, "upgrade_mode": ' '{"enum": ["test_run", "dry_run", ' '"upgrade"], "description": "Mode ' 'in which to run workflow"}, ' '"device_list": {"type": "array", ' '"description": "List of device ' 'UUIDs to be upgraded", "items": ' '{"title": "device uuid", "type": ' '"string", "format": "uuid"}}, ' '"image_devices": {"type": "array", ' '"items": {"title": "Image ' 'Devices", "type": "object", ' '"description": "List of images and ' 'corresponding devices to upgrade", ' '"additionalProperties": false, ' '"properties": {"image_uuid": ' '{"type": "string"}, "device_list": ' '{"type": "array", "description": ' '"List of device UUIDs to be ' 'upgraded with this image", ' '"items": {"title": "device uuid", ' '"type": "string", "format": ' '"uuid"}}}, "required": ' '["image_uuid", "device_list"]}}, ' '"advanced_parameters": {"title": ' '"Advanced parameters", ' '"description": "Optional ' 'parameters used to override ' 'defaults", "type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bulk_device_upgrade_count": ' '{"type": "integer", "description": ' '"Maximum number of devices to ' 'upgrade simultaneously", ' '"default": 4}, ' '"health_check_abort": {"type": ' '"boolean", "description": ' '"Enable/disable abort upon health ' 'check failures", "default": true}, ' '"Juniper": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp_flap_count": {"type": ' '"integer", "description": "Number ' 'of flaps allowed for BGP ' 'neighbors", "default": 4}, ' '"bgp_flap_count_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp_flap_count ' 'check", "default": true}, ' '"bgp_down_peer_count": {"type": ' '"integer", "description": "Number ' 'of down peers allowed", "default": ' '0}, "bgp_down_peer_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable ' 'bgp_down_peer_count check", ' '"default": true}, ' '"bgp_peer_state_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp peer state ' 'check", "default": true}}}, ' '"alarm": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"system_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable system alarm ' 'check", "default": true}, ' '"chassis_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable chassis alarm ' 'check", "default": true}}}, ' '"interface": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"interface_error_check": {"type": ' '"boolean", "description": ' '"Enable/disable interface error ' 'check", "default": true}, ' '"interface_drop_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface drop ' 'check", "default": true}, ' '"interface_carrier_transition_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface carrier ' 'transition check", "default": ' 'true}}}, "routing_engine": ' '{"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"routing_engine_cpu_idle": ' '{"type": "integer", "description": ' '"Routing engine CPU idle time", ' '"default": 60}, ' '"routing_engine_cpu_idle_check": ' '{"type": "boolean", "description": ' '"Enable/disable routing engine CLU ' 'idle time check", "default": ' 'true}}}, "fpc": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"fpc_cpu_5min_avg": {"type": ' '"integer", "description": "FPC CPU ' '5 minute average utilization", ' '"default": 50}, ' '"fpc_cpu_5min_avg_check": {"type": ' '"boolean", "description": ' '"Enable/disable FPC CPU 5 minute ' 'average utilizationcheck", ' '"default": true}, ' '"fpc_memory_heap_util": {"type": ' '"integer", "description": "FPC ' 'memory heap utilization", ' '"default": 45}, ' '"fpc_memory_heap_util_check": ' '{"type": "boolean", "description": ' '"Enable/disable FPC memory heap ' 'utilization check", "default": ' 'true}}}, ' '"active_route_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable active route count ' 'check", "default": true}, ' '"l2_total_mac_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable l2 total mac count ' 'check", "default": true}, ' '"storm_control_flag_check": ' '{"type": "boolean", "description": ' '"Enable/disable storm control flag ' 'check", "default": true}, "lacp": ' '{"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"lacp_down_local_check": {"type": ' '"boolean", "description": ' '"Enable/disable local interface ' 'down check", "default": true}, ' '"lacp_down_peer_check": {"type": ' '"boolean", "description": ' '"Enable/disable peer interface ' 'down check", "default": ' 'true}}}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hitless_upgrade_strategy.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 90, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hitless_upgrade.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2e14a38b-6861-4cc0-a072-5d1415e886ed'}, 'oper': 'CREATE', 'request-id': 'req-4066f7ca-501e-4425-a7b4-cc8739ad1004', 'type': 'job_template', 'uuid': '2e14a38b-6861-4cc0-a072-5d1415e886ed'} 06/02/2025 02:07:43.520 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'opencontrail'] not found in DB: Unknown id: service_appliance_set default-global-system-config:opencontrail 06/02/2025 02:07:43.521 7fad854d1b70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_appliance_set identifier_name = default-global-system-config:opencontrail url = https://10.0.0.129:8082/service-appliance-sets operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-svc-monitor remote_ip = 10.0.0.129 body = {"service-appliance-set": {"uuid": null, "fq_name": ["default-global-system-config", "opencontrail"], "parent_type": "global-system-config", "service_appliance_driver": "svc_monitor.services.loadbalancer.drivers.ha_proxy.driver.OpencontrailLoadbalancerDriver", "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 5, "share": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "display_name": "opencontrail"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.521 7fad854d1b70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_appliance_set identifier_name = default-global-system-config:opencontrail url = https://10.0.0.129:8082/service-appliance-sets operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-svc-monitor remote_ip = 10.0.0.129 body = {"service-appliance-set": {"uuid": null, "fq_name": ["default-global-system-config", "opencontrail"], "parent_type": "global-system-config", "service_appliance_driver": "svc_monitor.services.loadbalancer.drivers.ha_proxy.driver.OpencontrailLoadbalancerDriver", "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 5, "share": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "display_name": "opencontrail"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.562 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'opencontrail'], 'obj_dict': {'display_name': 'opencontrail', 'fq_name': ['default-global-system-config', 'opencontrail'], 'id_perms': {'created': '2025-06-02T02:07:43.551634', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:43.551634', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12650396292208914152, 'uuid_mslong': 293944591815036548}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 5, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service_appliance_driver': 'svc_monitor.services.loadbalancer.drivers.ha_proxy.driver.OpencontrailLoadbalancerDriver', 'uuid': '04144d0c-82c8-4e84-af8f-3c673107eee8'}, 'oper': 'CREATE', 'request-id': 'req-eedea8e4-2ac0-4889-8f59-39ae40bf891d', 'type': 'service_appliance_set', 'uuid': '04144d0c-82c8-4e84-af8f-3c673107eee8'} 06/02/2025 02:07:43.595 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'maintenance_mode_activate_template'] not found in DB: Unknown id: job_template default-global-system-config:maintenance_mode_activate_template 06/02/2025 02:07:43.603 7fad862496d8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:maintenance_mode_activate_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "maintenance_mode_activate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/maintenance_mode_activate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Activate maintenance mode\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_uuid\", \"device_uuid\"], \"properties\": {\"fabric_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Fabric UUID\", \"description\": \"UUID of the device fabric\"}, \"device_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Device UUID\", \"description\": \"UUID of the device to enter maintenance mode\"}, \"mode\": {\"enum\": [\"test_run\", \"activate\"], \"description\": \"Mode in which to run workflow\"}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"validate_critical_roles\": {\"type\": \"boolean\", \"description\": \"Enable/disable critical role validation\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on target device\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on peer device\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Activate maintenance mode output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Maintenance Mode Activation", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.604 7fad862496d8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:maintenance_mode_activate_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "maintenance_mode_activate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/maintenance_mode_activate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Activate maintenance mode\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_uuid\", \"device_uuid\"], \"properties\": {\"fabric_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Fabric UUID\", \"description\": \"UUID of the device fabric\"}, \"device_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Device UUID\", \"description\": \"UUID of the device to enter maintenance mode\"}, \"mode\": {\"enum\": [\"test_run\", \"activate\"], \"description\": \"Mode in which to run workflow\"}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"validate_critical_roles\": {\"type\": \"boolean\", \"description\": \"Enable/disable critical role validation\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on target device\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on peer device\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Activate maintenance mode output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Maintenance Mode Activation", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.747 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'maintenance_mode_activate_template'], 'obj_dict': {'display_name': 'Maintenance Mode Activation', 'fq_name': ['default-global-system-config', 'maintenance_mode_activate_template'], 'id_perms': {'created': '2025-06-02T02:07:43.631045', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:43.631045', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9251265705504787596, 'uuid_mslong': 12616943033492655814}}, 'job_template_concurrency_level': 'device', 'job_template_input_schema': '{"title": "Activate maintenance ' 'mode", "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_uuid", ' '"device_uuid"], "properties": ' '{"fabric_uuid": {"format": "uuid", ' '"type": "string", "title": "Fabric ' 'UUID", "description": "UUID of the ' 'device fabric"}, "device_uuid": ' '{"format": "uuid", "type": ' '"string", "title": "Device UUID", ' '"description": "UUID of the device ' 'to enter maintenance mode"}, ' '"mode": {"enum": ["test_run", ' '"activate"], "description": "Mode ' 'in which to run workflow"}, ' '"advanced_parameters": {"title": ' '"Advanced parameters", ' '"description": "Optional ' 'parameters used to override ' 'defaults", "type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bulk_device_upgrade_count": ' '{"type": "integer", "description": ' '"Maximum number of devices to ' 'upgrade simultaneously", ' '"default": 4}, ' '"health_check_abort": {"type": ' '"boolean", "description": ' '"Enable/disable abort upon health ' 'check failures", "default": true}, ' '"validate_critical_roles": ' '{"type": "boolean", "description": ' '"Enable/disable critical role ' 'validation", "default": true}, ' '"Juniper": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp_flap_count": {"type": ' '"integer", "description": "Number ' 'of flaps allowed for BGP ' 'neighbors", "default": 4}, ' '"bgp_flap_count_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp_flap_count ' 'check", "default": true}, ' '"bgp_down_peer_count": {"type": ' '"integer", "description": "Number ' 'of down peers allowed", "default": ' '0}, "bgp_down_peer_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable ' 'bgp_down_peer_count check", ' '"default": true}, ' '"bgp_peer_state_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp peer state ' 'check", "default": true}}}, ' '"alarm": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"system_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable system alarm ' 'check", "default": true}, ' '"chassis_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable chassis alarm ' 'check", "default": true}}}, ' '"interface": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"interface_error_check": {"type": ' '"boolean", "description": ' '"Enable/disable interface error ' 'check", "default": true}, ' '"interface_drop_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface drop ' 'check", "default": true}, ' '"interface_carrier_transition_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface carrier ' 'transition check", "default": ' 'true}}}, "routing_engine": ' '{"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"routing_engine_cpu_idle": ' '{"type": "integer", "description": ' '"Routing engine CPU idle time", ' '"default": 60}, ' '"routing_engine_cpu_idle_check": ' '{"type": "boolean", "description": ' '"Enable/disable routing engine CLU ' 'idle time check", "default": ' 'true}}}, "fpc": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"fpc_cpu_5min_avg": {"type": ' '"integer", "description": "FPC CPU ' '5 minute average utilization", ' '"default": 50}, ' '"fpc_cpu_5min_avg_check": {"type": ' '"boolean", "description": ' '"Enable/disable FPC CPU 5 minute ' 'average utilizationcheck", ' '"default": true}, ' '"fpc_memory_heap_util": {"type": ' '"integer", "description": "FPC ' 'memory heap utilization", ' '"default": 45}, ' '"fpc_memory_heap_util_check": ' '{"type": "boolean", "description": ' '"Enable/disable FPC memory heap ' 'utilization check", "default": ' 'true}}}, "lacp": {"type": ' '"object", "additionalProperties": ' 'false, "default": {}, ' '"properties": ' '{"lacp_down_local_check": {"type": ' '"boolean", "description": "Enable ' 'lacp interface status check on ' 'target device", "default": true}, ' '"lacp_down_peer_check": {"type": ' '"boolean", "description": "Enable ' 'lacp interface status check on ' 'peer device", "default": true}}}, ' '"active_route_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable active route count ' 'check", "default": true}, ' '"l2_total_mac_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable l2 total mac count ' 'check", "default": true}, ' '"storm_control_flag_check": ' '{"type": "boolean", "description": ' '"Enable/disable storm control flag ' 'check", "default": true}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Activate maintenance ' 'mode output", "type": "object", ' '"properties": {"status": {"type": ' '"string", "enum": ["Success", ' '"Failure", "Timeout"], ' '"description": "Result status of ' 'the job"}, "message": {"type": ' '"string", "description": "Should ' 'capture a summarized error ' 'message in case of Failures."}, ' '"results": {"type": "object", ' '"description": "JSON object ' 'holding the job specific output ' 'details"}}, "required": ' '["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/maintenance_mode_activate.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'af1862d7-6eab-4ec6-8063-1924d35dcc8c'}, 'oper': 'CREATE', 'request-id': 'req-22c305ec-4198-479b-8824-e6e6b263b9ed', 'type': 'job_template', 'uuid': 'af1862d7-6eab-4ec6-8063-1924d35dcc8c'} 06/02/2025 02:07:43.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:43.761 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 06/02/2025 02:07:43.761 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 06/02/2025 02:07:43.762 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 06/02/2025 02:07:43.763 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 06/02/2025 02:07:43.763 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 06/02/2025 02:07:43.763 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 06/02/2025 02:07:43.763 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 06/02/2025 02:07:43.763 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 06/02/2025 02:07:43.763 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 06/02/2025 02:07:43.763 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 06/02/2025 02:07:43.763 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 06/02/2025 02:07:43.763 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 06/02/2025 02:07:43.763 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 06/02/2025 02:07:43.764 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 06/02/2025 02:07:43.764 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 06/02/2025 02:07:43.764 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 06/02/2025 02:07:43.764 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 06/02/2025 02:07:43.764 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 06/02/2025 02:07:43.764 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 06/02/2025 02:07:43.764 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 06/02/2025 02:07:43.764 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 06/02/2025 02:07:43.764 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 06/02/2025 02:07:43.764 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 06/02/2025 02:07:43.764 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 06/02/2025 02:07:43.765 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 06/02/2025 02:07:43.765 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 06/02/2025 02:07:43.765 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 06/02/2025 02:07:43.765 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 06/02/2025 02:07:43.765 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 06/02/2025 02:07:43.765 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 06/02/2025 02:07:43.765 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 06/02/2025 02:07:43.765 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 06/02/2025 02:07:43.765 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 06/02/2025 02:07:43.765 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 06/02/2025 02:07:43.821 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'native'] not found in DB: Unknown id: service_appliance_set default-global-system-config:native 06/02/2025 02:07:43.823 7fad855e8ac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_appliance_set identifier_name = default-global-system-config:native url = https://10.0.0.129:8082/service-appliance-sets operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-svc-monitor remote_ip = 10.0.0.129 body = {"service-appliance-set": {"uuid": null, "fq_name": ["default-global-system-config", "native"], "parent_type": "global-system-config", "service_appliance_driver": "svc_monitor.services.loadbalancer.drivers.native.driver.OpencontrailLoadbalancerDriver", "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 5, "share": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "display_name": "native"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.823 7fad855e8ac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_appliance_set identifier_name = default-global-system-config:native url = https://10.0.0.129:8082/service-appliance-sets operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-svc-monitor remote_ip = 10.0.0.129 body = {"service-appliance-set": {"uuid": null, "fq_name": ["default-global-system-config", "native"], "parent_type": "global-system-config", "service_appliance_driver": "svc_monitor.services.loadbalancer.drivers.native.driver.OpencontrailLoadbalancerDriver", "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 5, "share": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "display_name": "native"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.841 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'maintenance_mode_deactivate_template'] not found in DB: Unknown id: job_template default-global-system-config:maintenance_mode_deactivate_template 06/02/2025 02:07:43.855 7fad85441d68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:maintenance_mode_deactivate_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "maintenance_mode_deactivate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/maintenance_mode_deactivate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Deactivate maintenance mode\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_uuid\", \"device_uuid\"], \"properties\": {\"fabric_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Fabric UUID\", \"description\": \"UUID of the device fabric\"}, \"device_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Device UUID\", \"description\": \"UUID of the device to exit maintenance mode\"}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on target device\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on peer device\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Deactivate maintenance mode output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Maintenance Mode Deactivation", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.855 7fad85441d68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:maintenance_mode_deactivate_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "maintenance_mode_deactivate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/maintenance_mode_deactivate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Deactivate maintenance mode\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_uuid\", \"device_uuid\"], \"properties\": {\"fabric_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Fabric UUID\", \"description\": \"UUID of the device fabric\"}, \"device_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Device UUID\", \"description\": \"UUID of the device to exit maintenance mode\"}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on target device\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on peer device\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Deactivate maintenance mode output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Maintenance Mode Deactivation", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:43.883 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'native'], 'obj_dict': {'display_name': 'native', 'fq_name': ['default-global-system-config', 'native'], 'id_perms': {'created': '2025-06-02T02:07:43.858045', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:43.858045', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13287011391871373295, 'uuid_mslong': 11085472205395609980}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 5, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service_appliance_driver': 'svc_monitor.services.loadbalancer.drivers.native.driver.OpencontrailLoadbalancerDriver', 'uuid': '99d7823c-ca12-497c-b864-f2769b0fcfef'}, 'oper': 'CREATE', 'request-id': 'req-ab8d0ea3-eb60-4a4f-9c09-d56be275f399', 'type': 'service_appliance_set', 'uuid': '99d7823c-ca12-497c-b864-f2769b0fcfef'} 06/02/2025 02:07:43.975 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'maintenance_mode_deactivate_template'], 'obj_dict': {'display_name': 'Maintenance Mode Deactivation', 'fq_name': ['default-global-system-config', 'maintenance_mode_deactivate_template'], 'id_perms': {'created': '2025-06-02T02:07:43.907005', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:43.907005', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12789274859749818970, 'uuid_mslong': 10604532711180880752}}, 'job_template_concurrency_level': 'device', 'job_template_input_schema': '{"title": "Deactivate maintenance ' 'mode", "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_uuid", ' '"device_uuid"], "properties": ' '{"fabric_uuid": {"format": "uuid", ' '"type": "string", "title": "Fabric ' 'UUID", "description": "UUID of the ' 'device fabric"}, "device_uuid": ' '{"format": "uuid", "type": ' '"string", "title": "Device UUID", ' '"description": "UUID of the device ' 'to exit maintenance mode"}, ' '"advanced_parameters": {"title": ' '"Advanced parameters", ' '"description": "Optional ' 'parameters used to override ' 'defaults", "type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bulk_device_upgrade_count": ' '{"type": "integer", "description": ' '"Maximum number of devices to ' 'upgrade simultaneously", ' '"default": 4}, ' '"health_check_abort": {"type": ' '"boolean", "description": ' '"Enable/disable abort upon health ' 'check failures", "default": true}, ' '"Juniper": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp_flap_count": {"type": ' '"integer", "description": "Number ' 'of flaps allowed for BGP ' 'neighbors", "default": 4}, ' '"bgp_flap_count_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp_flap_count ' 'check", "default": true}, ' '"bgp_down_peer_count": {"type": ' '"integer", "description": "Number ' 'of down peers allowed", "default": ' '0}, "bgp_down_peer_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable ' 'bgp_down_peer_count check", ' '"default": true}, ' '"bgp_peer_state_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp peer state ' 'check", "default": true}}}, ' '"alarm": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"system_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable system alarm ' 'check", "default": true}, ' '"chassis_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable chassis alarm ' 'check", "default": true}}}, ' '"interface": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"interface_error_check": {"type": ' '"boolean", "description": ' '"Enable/disable interface error ' 'check", "default": true}, ' '"interface_drop_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface drop ' 'check", "default": true}, ' '"interface_carrier_transition_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface carrier ' 'transition check", "default": ' 'true}}}, "routing_engine": ' '{"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"routing_engine_cpu_idle": ' '{"type": "integer", "description": ' '"Routing engine CPU idle time", ' '"default": 60}, ' '"routing_engine_cpu_idle_check": ' '{"type": "boolean", "description": ' '"Enable/disable routing engine CLU ' 'idle time check", "default": ' 'true}}}, "fpc": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"fpc_cpu_5min_avg": {"type": ' '"integer", "description": "FPC CPU ' '5 minute average utilization", ' '"default": 50}, ' '"fpc_cpu_5min_avg_check": {"type": ' '"boolean", "description": ' '"Enable/disable FPC CPU 5 minute ' 'average utilizationcheck", ' '"default": true}, ' '"fpc_memory_heap_util": {"type": ' '"integer", "description": "FPC ' 'memory heap utilization", ' '"default": 45}, ' '"fpc_memory_heap_util_check": ' '{"type": "boolean", "description": ' '"Enable/disable FPC memory heap ' 'utilization check", "default": ' 'true}}}, "lacp": {"type": ' '"object", "additionalProperties": ' 'false, "default": {}, ' '"properties": ' '{"lacp_down_local_check": {"type": ' '"boolean", "description": "Enable ' 'lacp interface status check on ' 'target device", "default": true}, ' '"lacp_down_peer_check": {"type": ' '"boolean", "description": "Enable ' 'lacp interface status check on ' 'peer device", "default": true}}}, ' '"active_route_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable active route count ' 'check", "default": true}, ' '"l2_total_mac_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable l2 total mac count ' 'check", "default": true}, ' '"storm_control_flag_check": ' '{"type": "boolean", "description": ' '"Enable/disable storm control flag ' 'check", "default": true}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Deactivate maintenance ' 'mode output", "type": "object", ' '"properties": {"status": {"type": ' '"string", "enum": ["Success", ' '"Failure", "Timeout"], ' '"description": "Result status of ' 'the job"}, "message": {"type": ' '"string", "description": "Should ' 'capture a summarized error ' 'message in case of Failures."}, ' '"results": {"type": "object", ' '"description": "JSON object ' 'holding the job specific output ' 'details"}}, "required": ' '["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/maintenance_mode_deactivate.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '932ade50-caf2-4b70-b17c-a1b97638c25a'}, 'oper': 'CREATE', 'request-id': 'req-7a5ec535-82af-4207-a7da-ec3a16243eec', 'type': 'job_template', 'uuid': '932ade50-caf2-4b70-b17c-a1b97638c25a'} 06/02/2025 02:07:44.029 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_DNS_refs in resource network-ipam: 'virtual_DNS_refs' 06/02/2025 02:07:44.029 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource network-ipam: 'tag_refs' 06/02/2025 02:07:44.029 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_network_back_refs in resource network-ipam: 'virtual_network_back_refs' 06/02/2025 02:07:44.029 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_router_back_refs in resource network-ipam: 'virtual_router_back_refs' 06/02/2025 02:07:44.030 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource network-ipam: 'instance_ip_back_refs' 06/02/2025 02:07:44.040 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 06/02/2025 02:07:44.040 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 06/02/2025 02:07:44.041 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 06/02/2025 02:07:44.041 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 06/02/2025 02:07:44.041 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 06/02/2025 02:07:44.041 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 06/02/2025 02:07:44.042 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 06/02/2025 02:07:44.042 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 06/02/2025 02:07:44.043 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 06/02/2025 02:07:44.043 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 06/02/2025 02:07:44.043 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 06/02/2025 02:07:44.043 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 06/02/2025 02:07:44.043 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 06/02/2025 02:07:44.043 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 06/02/2025 02:07:44.043 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 06/02/2025 02:07:44.044 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 06/02/2025 02:07:44.044 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 06/02/2025 02:07:44.044 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 06/02/2025 02:07:44.044 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 06/02/2025 02:07:44.044 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 06/02/2025 02:07:44.044 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 06/02/2025 02:07:44.044 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 06/02/2025 02:07:44.044 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 06/02/2025 02:07:44.044 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 06/02/2025 02:07:44.044 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 06/02/2025 02:07:44.044 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 06/02/2025 02:07:44.045 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 06/02/2025 02:07:44.045 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 06/02/2025 02:07:44.045 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 06/02/2025 02:07:44.045 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 06/02/2025 02:07:44.045 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 06/02/2025 02:07:44.045 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 06/02/2025 02:07:44.045 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 06/02/2025 02:07:44.045 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 06/02/2025 02:07:44.075 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'discover_device_template'] not found in DB: Unknown id: job_template default-global-system-config:discover_device_template 06/02/2025 02:07:44.083 7fad85467630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_device_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_device_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_device.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"minProperties\": 1, \"maxProperties\": 1, \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"fabric_fq_name\": {\"$id\": \"/properties/input/properties/fabric_fq_name\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/input/properties/fabric_fq_name/items\", \"type\": \"string\", \"title\": \"The Fabric_fq_name Schema\", \"description\": \"FQNAME of the fabric object created\", \"default\": \"\", \"examples\": [\"default-global-system-config\", \"fabric01\"]}}, \"manage_underlay\": {\"type\": \"boolean\", \"title\": \"Manage underlay networking\", \"description\": \"Set to true if need to configure device underlay networking\"}}}", "job_template_output_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"output\": {\"$id\": \"/properties/output\", \"type\": \"object\", \"properties\": {\"status\": {\"$id\": \"/properties/output/properties/status\", \"type\": \"string\", \"title\": \"The Status Schema\", \"description\": \"Status of the plabybook run\", \"default\": \"\", \"examples\": [\"SUCCESS\"]}, \"message\": {\"$id\": \"/properties/output/properties/message\", \"type\": \"string\", \"title\": \"The Message Schema\", \"description\": \"success/failure message about the playbook run\", \"default\": \"\", \"examples\": [\"Successfully ran playbook\"]}, \"results\": {\"$id\": \"/properties/output/properties/results\", \"type\": \"object\", \"properties\": {\"device_uuid\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid/items\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Results Schema\", \"description\": \"objects returned from the playbook to the job_manager\", \"default\": \"\", \"examples\": [\"1234\"]}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover Device", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:44.083 7fad85467630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_device_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_device_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_device.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"minProperties\": 1, \"maxProperties\": 1, \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"fabric_fq_name\": {\"$id\": \"/properties/input/properties/fabric_fq_name\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/input/properties/fabric_fq_name/items\", \"type\": \"string\", \"title\": \"The Fabric_fq_name Schema\", \"description\": \"FQNAME of the fabric object created\", \"default\": \"\", \"examples\": [\"default-global-system-config\", \"fabric01\"]}}, \"manage_underlay\": {\"type\": \"boolean\", \"title\": \"Manage underlay networking\", \"description\": \"Set to true if need to configure device underlay networking\"}}}", "job_template_output_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"output\": {\"$id\": \"/properties/output\", \"type\": \"object\", \"properties\": {\"status\": {\"$id\": \"/properties/output/properties/status\", \"type\": \"string\", \"title\": \"The Status Schema\", \"description\": \"Status of the plabybook run\", \"default\": \"\", \"examples\": [\"SUCCESS\"]}, \"message\": {\"$id\": \"/properties/output/properties/message\", \"type\": \"string\", \"title\": \"The Message Schema\", \"description\": \"success/failure message about the playbook run\", \"default\": \"\", \"examples\": [\"Successfully ran playbook\"]}, \"results\": {\"$id\": \"/properties/output/properties/results\", \"type\": \"object\", \"properties\": {\"device_uuid\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid/items\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Results Schema\", \"description\": \"objects returned from the playbook to the job_manager\", \"default\": \"\", \"examples\": [\"1234\"]}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover Device", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:44.160 7fad854d1b70 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'] not found in DB: Unknown id: analytics_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 06/02/2025 02:07:44.166 7fad8583b978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.129 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.129", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:44.167 7fad8583b978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.129 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.129", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:44.170 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'discover_device_template'], 'obj_dict': {'display_name': 'Discover Device', 'fq_name': ['default-global-system-config', 'discover_device_template'], 'id_perms': {'created': '2025-06-02T02:07:44.113940', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:44.113940', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13254355483690758732, 'uuid_mslong': 10933528954466683037}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"minProperties": 1, ' '"maxProperties": 1, ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"$id": ' '"/properties/input/properties/fabric_uuid", ' '"format": "uuid", "type": ' '"string", "title": "The ' 'Fabric_uuid Schema", ' '"description": "UUID of the fabric ' 'object created", "default": "", ' '"examples": ["123456789"]}, ' '"fabric_fq_name": {"$id": ' '"/properties/input/properties/fabric_fq_name", ' '"type": "array", "items": {"$id": ' '"/properties/input/properties/fabric_fq_name/items", ' '"type": "string", "title": "The ' 'Fabric_fq_name Schema", ' '"description": "FQNAME of the ' 'fabric object created", "default": ' '"", "examples": ' '["default-global-system-config", ' '"fabric01"]}}, "manage_underlay": ' '{"type": "boolean", "title": ' '"Manage underlay networking", ' '"description": "Set to true if ' 'need to configure device underlay ' 'networking"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"properties": {"output": {"$id": ' '"/properties/output", "type": ' '"object", "properties": ' '{"status": {"$id": ' '"/properties/output/properties/status", ' '"type": "string", "title": "The ' 'Status Schema", "description": ' '"Status of the plabybook run", ' '"default": "", "examples": ' '["SUCCESS"]}, "message": {"$id": ' '"/properties/output/properties/message", ' '"type": "string", "title": "The ' 'Message Schema", "description": ' '"success/failure message about ' 'the playbook run", "default": "", ' '"examples": ["Successfully ran ' 'playbook"]}, "results": {"$id": ' '"/properties/output/properties/results", ' '"type": "object", "properties": ' '{"device_uuid": {"$id": ' '"/properties/output/properties/results/properties/device_uuid", ' '"type": "array", "items": {"$id": ' '"/properties/output/properties/results/properties/device_uuid/items", ' '"format": "uuid", "type": ' '"string", "title": "The Results ' 'Schema", "description": "objects ' 'returned from the playbook to ' 'the job_manager", "default": "", ' '"examples": ["1234"]}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_device.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': ''}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '97bbb2a7-e06f-489d-b7f0-ee167c23724c'}, 'oper': 'CREATE', 'request-id': 'req-28aebfe2-12ef-4771-a557-c16da4d141d0', 'type': 'job_template', 'uuid': '97bbb2a7-e06f-489d-b7f0-ee167c23724c'} 06/02/2025 02:07:44.231 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.129', 'display_name': 'cn-jenkins-deploy-platform-juju-os-542-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'id_perms': {'created': '2025-06-02T02:07:44.197414', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:44.197414', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12695487633019255258, 'uuid_mslong': 11397447389066053208}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9e2bde03-9b7c-4658-b02f-6ebd187a39da'}, 'oper': 'CREATE', 'request-id': 'req-f7b5007c-9c96-4460-8319-19d4abd1443a', 'type': 'analytics_node', 'uuid': '9e2bde03-9b7c-4658-b02f-6ebd187a39da'} 06/02/2025 02:07:44.232 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 06/02/2025 02:07:44.247 7fad86916390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:07:44.247 7fad86916390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:07:44.247 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.248 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:07:44.248 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.248 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.248 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Generic Connection:Keystone[] connection down >>, ] >> 06/02/2025 02:07:44.248 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.248 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.248 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ConfigApiWorkerTrace: data = << name = worker-0 worker_id = 0 introspect_port = 8084 admin_port = 8095 introspect_url = https://10.0.0.129:8084 >> 06/02/2025 02:07:44.248 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.248 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3547538508817449897, "uuid_lslong": 11941414542463103012}, "enable": true, "created": "2025-06-02T02:07:38.838504", "last_modified": "2025-06-02T02:07:38.838504", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "283dd1d7-187e-4312-a690-9b0d77dd378d"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "313b637a-6515-43a9-a5b8-6d420f327024" } deleted = False >> 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:dci-network elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "dci-network"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 5491571884461998138, "uuid_lslong": 10815328664779595480}, "enable": true, "created": "2025-06-02T02:07:39.539649", "last_modified": "2025-06-02T02:07:40.721738", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : falseis_shared : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"parent_uuid : "313b637a-6515-43a9-a5b8-6d420f327024"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "4c35fb88-87e1-403a-9617-c41e59499ed8"virtual_network_category : "tenant"virtual_network_network_id : 4 } deleted = False >> 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:ip-fabric elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "ip-fabric"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 16366545616506667243, "uuid_lslong": 10465735963771584814}, "enable": true, "created": "2025-06-02T02:07:39.241267", "last_modified": "2025-06-02T02:07:40.731687", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : trueis_shared : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"parent_uuid : "313b637a-6515-43a9-a5b8-6d420f327024"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "e321a686-481b-40eb-913d-c368c1a2c12e"virtual_network_category : "tenant"virtual_network_network_id : 2 } deleted = False >> 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:__link_local__ elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "__link_local__"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 16257347393596375814, "uuid_lslong": 12265952371504274765}, "enable": true, "created": "2025-06-02T02:07:39.416880", "last_modified": "2025-06-02T02:07:40.732996", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : falseis_shared : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"parent_uuid : "313b637a-6515-43a9-a5b8-6d420f327024"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "e19db351-c16f-4306-aa39-6ab1af5f5d4d"virtual_network_category : "tenant"virtual_network_network_id : 3 } deleted = False >> 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:default-virtual-network elements = { fq_name : ["default-domain", "default-project", "default-virtual-network"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 15267011952473687091, "uuid_lslong": 12941292602126547315}, "enable": true, "created": "2025-06-02T02:07:38.930862", "last_modified": "2025-06-02T02:07:40.732404", "description": null, "user_visible": true, "creator": null}is_shared : falseparent_type : "project"parent_uuid : "313b637a-6515-43a9-a5b8-6d420f327024"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "d3df527b-90d6-4433-b398-b50e4424b973"virtual_network_network_id : 1 } deleted = False >> 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]global_vrouter_config_refs : [{"to": ["default-global-system-config", "default-global-vrouter-config"], "attr": null, "uuid": "26ae01a2-4559-44e7-8a63-b8afe58aeb73"}]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 291032418762048174, "uuid_lslong": 12588796230361022454}, "enable": true, "created": "2025-06-02T02:07:39.109254", "last_modified": "2025-06-02T02:07:39.143416", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"parent_uuid : "5d16c822-14d0-44c1-9d93-7f5edea93a1e"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "0409f471-626f-42ae-aeb4-63792471fff6" } deleted = False >> 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.249 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.250 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { _enable_security_policy_draft : false_type : "project"_uuid : nullfq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3547538508817449897, "uuid_lslong": 11941414542463103012}, "enable": true, "created": "2025-06-02T02:07:38.838504", "last_modified": "2025-06-02T02:07:38.838504", "description": null, "user_visible": true, "creator": null}name : "default-project"parent_type : "domain"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "313b637a-6515-43a9-a5b8-6d420f327024" } deleted = False >> 06/02/2025 02:07:44.250 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.250 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.250 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:default-virtual-network elements = { _fabric_snat : false_flood_unknown_unicast : false_igmp_enable : false_is_provider_network : false_layer2_control_word : false_mac_aging_time : 300_mac_ip_learning_enable : false_mac_learning_enabled : false_pbb_etree_enable : false_pbb_evpn_enable : false_port_security_enabled : true_type : "virtual-network"_uuid : null_virtual_network_category : "tenant"fq_name : ["default-domain", "default-project", "default-virtual-network"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 15267011952473687091, "uuid_lslong": 12941292602126547315}, "enable": true, "created": "2025-06-02T02:07:38.930862", "last_modified": "2025-06-02T02:07:38.930862", "description": null, "user_visible": true, "creator": null}name : "default-virtual-network"parent_type : "project"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "d3df527b-90d6-4433-b398-b50e4424b973"virtual_network_network_id : 1 } deleted = False >> 06/02/2025 02:07:44.250 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.250 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.250 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 291032418762048174, "uuid_lslong": 12588796230361022454}, "enable": true, "created": "2025-06-02T02:07:39.109254", "last_modified": "2025-06-02T02:07:39.109254", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "0409f471-626f-42ae-aeb4-63792471fff6" } deleted = False >> 06/02/2025 02:07:44.250 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.250 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.250 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]global_vrouter_config_refs : [{"to": ["default-global-system-config", "default-global-vrouter-config"], "attr": null, "uuid": "26ae01a2-4559-44e7-8a63-b8afe58aeb73"}]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 291032418762048174, "uuid_lslong": 12588796230361022454}, "enable": true, "created": "2025-06-02T02:07:39.109254", "last_modified": "2025-06-02T02:07:39.143416", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"parent_uuid : "5d16c822-14d0-44c1-9d93-7f5edea93a1e"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "0409f471-626f-42ae-aeb4-63792471fff6" } deleted = False >> 06/02/2025 02:07:44.250 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.250 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.251 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:ip-fabric elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "ip-fabric"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 16366545616506667243, "uuid_lslong": 10465735963771584814}, "enable": true, "created": "2025-06-02T02:07:39.241267", "last_modified": "2025-06-02T02:07:39.241267", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : truelayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "e321a686-481b-40eb-913d-c368c1a2c12e"virtual_network_category : "tenant"virtual_network_network_id : 2 } deleted = False >> 06/02/2025 02:07:44.251 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.251 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.251 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:__link_local__ elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "__link_local__"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 16257347393596375814, "uuid_lslong": 12265952371504274765}, "enable": true, "created": "2025-06-02T02:07:39.416880", "last_modified": "2025-06-02T02:07:39.416880", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "e19db351-c16f-4306-aa39-6ab1af5f5d4d"virtual_network_category : "tenant"virtual_network_network_id : 3 } deleted = False >> 06/02/2025 02:07:44.251 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.251 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.251 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:dci-network elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "dci-network"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 5491571884461998138, "uuid_lslong": 10815328664779595480}, "enable": true, "created": "2025-06-02T02:07:39.539649", "last_modified": "2025-06-02T02:07:39.539649", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "4c35fb88-87e1-403a-9617-c41e59499ed8"virtual_network_category : "tenant"virtual_network_network_id : 4 } deleted = False >> 06/02/2025 02:07:44.251 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.251 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.251 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:default-application-policy-set elements = { all_applications : truefq_name : ["default-domain", "default-project", "default-application-policy-set"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 11475883316388380805, "uuid_lslong": 12597980142772293036}, "enable": true, "created": "2025-06-02T02:07:40.667446", "last_modified": "2025-06-02T02:07:40.667446", "description": null, "user_visible": true, "creator": null}parent_type : "project"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "9f428713-0d29-4085-aed5-0431615e0dac" } deleted = False >> 06/02/2025 02:07:44.251 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.251 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.252 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3547538508817449897, "uuid_lslong": 11941414542463103012}, "enable": true, "created": "2025-06-02T02:07:38.838504", "last_modified": "2025-06-02T02:07:40.828670", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "283dd1d7-187e-4312-a690-9b0d77dd378d"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}quota : {"defaults": -1}uuid : "313b637a-6515-43a9-a5b8-6d420f327024" } deleted = False >> 06/02/2025 02:07:44.252 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.252 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.252 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 elements = { database_node_ip_address : "10.0.0.129"display_name : "cn-jenkins-deploy-platform-juju-os-542-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2177284630240772820, "uuid_lslong": 9609144780282056865}, "enable": true, "created": "2025-06-02T02:07:42.421247", "last_modified": "2025-06-02T02:07:42.421247", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3b45d35b-de57-4285-b542-427e524b5c84"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "1e3744d5-e06b-42d4-855a-8a442802d0a1" } deleted = False >> 06/02/2025 02:07:44.252 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.253 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.253 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.0.0.129", "address": "10.0.0.129", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-juju-os-542-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-juju-os-542-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 1264630939244251380, "uuid_lslong": 13300429569056233772}, "enable": true, "created": "2025-06-02T02:07:42.809933", "last_modified": "2025-06-02T02:07:42.809933", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "5db59199-8d09-4071-9fea-ae1610ec70e7"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "118cdf23-919f-48f4-b894-9e396fb2d92c" } deleted = False >> 06/02/2025 02:07:44.254 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.254 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.254 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:07:44.254 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.254 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.254 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 elements = { analytics_alarm_node_ip_address : "10.0.0.129"display_name : "cn-jenkins-deploy-platform-juju-os-542-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 5010956081159489659, "uuid_lslong": 12631785540092545688}, "enable": true, "created": "2025-06-02T02:07:43.085708", "last_modified": "2025-06-02T02:07:43.085708", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3b45d35b-de57-4285-b542-427e524b5c84"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "458a7e01-b298-487b-af4d-1e05cc21ca98" } deleted = False >> 06/02/2025 02:07:44.254 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.254 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.254 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 elements = { analytics_node_ip_address : "10.0.0.129"display_name : "cn-jenkins-deploy-platform-juju-os-542-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 11397447389066053208, "uuid_lslong": 12695487633019255258}, "enable": true, "created": "2025-06-02T02:07:44.197414", "last_modified": "2025-06-02T02:07:44.197414", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3b45d35b-de57-4285-b542-427e524b5c84"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "9e2bde03-9b7c-4658-b02f-6ebd187a39da" } deleted = False >> 06/02/2025 02:07:44.254 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:44.254 7fad86916390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:07:44.255 7fad86916390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:07:44.258 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:44.259 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:44.259 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:44.259 7fad86916390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:44.259 7fad86916390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:07:44.260 7fad86916390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:44.294 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'discover_os_computes_template'] not found in DB: Unknown id: job_template default-global-system-config:discover_os_computes_template 06/02/2025 02:07:44.301 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_os_computes_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_os_computes_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_os_computes_template.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"minProperties\": 2, \"maxProperties\": 5, \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"contrail_command_host\": {\"$id\": \"/properties/input/properties/contrail_command_host\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"10.10.10.10:9091\"]}, \"cc_username\": {\"$id\": \"/properties/input/properties/cc_username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/input/properties/cc_password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"fabric_fq_name\": {\"$id\": \"/properties/input/properties/fabric_fq_name\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/input/properties/fabric_fq_name/items\", \"type\": \"string\", \"title\": \"The Fabric_fq_name Schema\", \"description\": \"FQNAME of the fabric object created\", \"default\": \"\", \"examples\": [\"default-global-system-config\", \"fabric01\"]}}, \"manage_underlay\": {\"type\": \"boolean\", \"title\": \"Manage underlay networking\", \"description\": \"Set to true if need to configure device underlay networking\"}}}", "job_template_output_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"output\": {\"$id\": \"/properties/output\", \"type\": \"object\", \"properties\": {\"status\": {\"$id\": \"/properties/output/properties/status\", \"type\": \"string\", \"title\": \"The Status Schema\", \"description\": \"Status of the plabybook run\", \"default\": \"\", \"examples\": [\"SUCCESS\"]}, \"message\": {\"$id\": \"/properties/output/properties/message\", \"type\": \"string\", \"title\": \"The Message Schema\", \"description\": \"success/failure message about the playbook run\", \"default\": \"\", \"examples\": [\"Successfully ran playbook\"]}, \"results\": {\"$id\": \"/properties/output/properties/results\", \"type\": \"object\", \"properties\": {\"device_uuid\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid/items\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Results Schema\", \"description\": \"objects returned from the playbook to the job_manager\", \"default\": \"\", \"examples\": [\"1234\"]}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover OS Computes", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:44.441 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'discover_os_computes_template'], 'obj_dict': {'display_name': 'Discover OS Computes', 'fq_name': ['default-global-system-config', 'discover_os_computes_template'], 'id_perms': {'created': '2025-06-02T02:07:44.349158', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:44.349158', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10979446350366882715, 'uuid_mslong': 2967268223537332607}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"minProperties": 2, ' '"maxProperties": 5, ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"$id": ' '"/properties/input/properties/fabric_uuid", ' '"format": "uuid", "type": ' '"string", "title": "The ' 'Fabric_uuid Schema", ' '"description": "UUID of the fabric ' 'object created", "default": "", ' '"examples": ["123456789"]}, ' '"contrail_command_host": {"$id": ' '"/properties/input/properties/contrail_command_host", ' '"format": "uuid", "type": ' '"string", "title": "The ' 'Fabric_uuid Schema", ' '"description": "UUID of the fabric ' 'object created", "default": "", ' '"examples": ["10.10.10.10:9091"]}, ' '"cc_username": {"$id": ' '"/properties/input/properties/cc_username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/input/properties/cc_password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, "fabric_fq_name": ' '{"$id": ' '"/properties/input/properties/fabric_fq_name", ' '"type": "array", "items": {"$id": ' '"/properties/input/properties/fabric_fq_name/items", ' '"type": "string", "title": "The ' 'Fabric_fq_name Schema", ' '"description": "FQNAME of the ' 'fabric object created", "default": ' '"", "examples": ' '["default-global-system-config", ' '"fabric01"]}}, "manage_underlay": ' '{"type": "boolean", "title": ' '"Manage underlay networking", ' '"description": "Set to true if ' 'need to configure device underlay ' 'networking"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"properties": {"output": {"$id": ' '"/properties/output", "type": ' '"object", "properties": ' '{"status": {"$id": ' '"/properties/output/properties/status", ' '"type": "string", "title": "The ' 'Status Schema", "description": ' '"Status of the plabybook run", ' '"default": "", "examples": ' '["SUCCESS"]}, "message": {"$id": ' '"/properties/output/properties/message", ' '"type": "string", "title": "The ' 'Message Schema", "description": ' '"success/failure message about ' 'the playbook run", "default": "", ' '"examples": ["Successfully ran ' 'playbook"]}, "results": {"$id": ' '"/properties/output/properties/results", ' '"type": "object", "properties": ' '{"device_uuid": {"$id": ' '"/properties/output/properties/results/properties/device_uuid", ' '"type": "array", "items": {"$id": ' '"/properties/output/properties/results/properties/device_uuid/items", ' '"format": "uuid", "type": ' '"string", "title": "The Results ' 'Schema", "description": "objects ' 'returned from the playbook to ' 'the job_manager", "default": "", ' '"examples": ["1234"]}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_os_computes_template.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': ''}]}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '292ddaba-613f-417f-985e-d448b813bb9b'}, 'oper': 'CREATE', 'request-id': 'req-fffea4ea-ce9a-4555-bb1d-bc3d9ce17bd2', 'type': 'job_template', 'uuid': '292ddaba-613f-417f-985e-d448b813bb9b'} 06/02/2025 02:07:44.450 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'analyzer-template'] not found in DB: Unknown id: service_template default-domain:analyzer-template 06/02/2025 02:07:44.454 7fad868f2f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:analyzer-template url = https://10.0.0.129:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-svc-monitor remote_ip = 10.0.0.129 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "analyzer-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": null, "service_type": "analyzer", "image_name": "analyzer", "service_scaling": false, "interface_type": [{"service_interface_type": "left", "shared_ip": false, "static_route_enable": false}], "flavor": "m1.medium", "ordered_interfaces": true, "service_virtualization_type": "virtual-machine", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "analyzer-template"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:44.529 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'analyzer-template'], 'obj_dict': {'display_name': 'analyzer-template', 'fq_name': ['default-domain', 'analyzer-template'], 'id_perms': {'created': '2025-06-02T02:07:44.503374', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:44.503374', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11465465424876613326, 'uuid_mslong': 10548766686829562123}}, 'parent_type': 'domain', 'parent_uuid': '283dd1d7-187e-4312-a690-9b0d77dd378d', 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': [{'tenant': 'domain:283dd1d7-187e-4312-a690-9b0d77dd378d', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': 'm1.medium', 'image_name': 'analyzer', 'instance_data': None, 'interface_type': [{'service_interface_type': 'left', 'shared_ip': False, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': None, 'service_scaling': False, 'service_type': 'analyzer', 'service_virtualization_type': 'virtual-machine', 'version': 1, 'vrouter_instance_type': None}, 'uuid': '9264bf69-72f3-490b-9f1d-840eaa4b2ece'}, 'oper': 'CREATE', 'request-id': 'req-91a1c1c9-d139-4b3e-aa70-ce5b4d3a86eb', 'type': 'service_template', 'uuid': '9264bf69-72f3-490b-9f1d-840eaa4b2ece'} 06/02/2025 02:07:44.592 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'discover_role_template'] not found in DB: Unknown id: job_template default-global-system-config:discover_role_template 06/02/2025 02:07:44.602 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'nat-template'] not found in DB: Unknown id: service_template default-domain:nat-template 06/02/2025 02:07:44.603 7fad868f2f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:nat-template url = https://10.0.0.129:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-svc-monitor remote_ip = 10.0.0.129 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "nat-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "in-network-nat", "service_type": "firewall", "image_name": "analyzer", "service_scaling": false, "interface_type": [{"service_interface_type": "management", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "right", "shared_ip": false, "static_route_enable": false}], "flavor": "m1.medium", "ordered_interfaces": true, "service_virtualization_type": "virtual-machine", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "nat-template"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:44.627 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_role_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_role_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_role.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover Role", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:44.659 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'nat-template'], 'obj_dict': {'display_name': 'nat-template', 'fq_name': ['default-domain', 'nat-template'], 'id_perms': {'created': '2025-06-02T02:07:44.646380', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:44.646380', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11830503237998599695, 'uuid_mslong': 8143293248239910965}}, 'parent_type': 'domain', 'parent_uuid': '283dd1d7-187e-4312-a690-9b0d77dd378d', 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': [{'tenant': 'domain:283dd1d7-187e-4312-a690-9b0d77dd378d', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': 'm1.medium', 'image_name': 'analyzer', 'instance_data': None, 'interface_type': [{'service_interface_type': 'management', 'shared_ip': False, 'static_route_enable': False}, {'service_interface_type': 'left', 'shared_ip': False, 'static_route_enable': False}, {'service_interface_type': 'right', 'shared_ip': False, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': 'in-network-nat', 'service_scaling': False, 'service_type': 'firewall', 'service_virtualization_type': 'virtual-machine', 'version': 1, 'vrouter_instance_type': None}, 'uuid': '7102ca10-732d-4035-a42e-6403a703de0f'}, 'oper': 'CREATE', 'request-id': 'req-4a7743e6-c7b4-40e1-8038-a3d496023e09', 'type': 'service_template', 'uuid': '7102ca10-732d-4035-a42e-6403a703de0f'} 06/02/2025 02:07:44.709 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'discover_role_template'], 'obj_dict': {'display_name': 'Discover Role', 'fq_name': ['default-global-system-config', 'discover_role_template'], 'id_perms': {'created': '2025-06-02T02:07:44.651575', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:44.651575', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10891987641521222590, 'uuid_mslong': 2670488751051918854}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_role.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '250f7b5e-c720-4e06-9728-1d0d3ed133be'}, 'oper': 'CREATE', 'request-id': 'req-a30399e6-ffbf-4e70-bdcf-4a5cfab46c63', 'type': 'job_template', 'uuid': '250f7b5e-c720-4e06-9728-1d0d3ed133be'} 06/02/2025 02:07:44.731 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'netns-snat-template'] not found in DB: Unknown id: service_template default-domain:netns-snat-template 06/02/2025 02:07:44.732 7fad868f2f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:netns-snat-template url = https://10.0.0.129:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-svc-monitor remote_ip = 10.0.0.129 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "netns-snat-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "in-network-nat", "service_type": "source-nat", "image_name": null, "service_scaling": true, "interface_type": [{"service_interface_type": "right", "shared_ip": true, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": true, "static_route_enable": false}], "flavor": null, "ordered_interfaces": true, "service_virtualization_type": "network-namespace", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "netns-snat-template"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:44.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:44.762 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'netns-snat-template'], 'obj_dict': {'display_name': 'netns-snat-template', 'fq_name': ['default-domain', 'netns-snat-template'], 'id_perms': {'created': '2025-06-02T02:07:44.750276', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:44.750276', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10339455576665069253, 'uuid_mslong': 9689298049352024650}}, 'parent_type': 'domain', 'parent_uuid': '283dd1d7-187e-4312-a690-9b0d77dd378d', 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': [{'tenant': 'domain:283dd1d7-187e-4312-a690-9b0d77dd378d', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': None, 'image_name': None, 'instance_data': None, 'interface_type': [{'service_interface_type': 'right', 'shared_ip': True, 'static_route_enable': False}, {'service_interface_type': 'left', 'shared_ip': True, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': 'in-network-nat', 'service_scaling': True, 'service_type': 'source-nat', 'service_virtualization_type': 'network-namespace', 'version': 1, 'vrouter_instance_type': None}, 'uuid': '86774d3d-6283-424a-8f7d-2010f20d96c5'}, 'oper': 'CREATE', 'request-id': 'req-62c5add1-fbd1-4457-b00c-64ea60a7c79a', 'type': 'service_template', 'uuid': '86774d3d-6283-424a-8f7d-2010f20d96c5'} 06/02/2025 02:07:44.807 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'device_import_template'] not found in DB: Unknown id: job_template default-global-system-config:device_import_template 06/02/2025 02:07:44.820 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'haproxy-loadbalancer-template'] not found in DB: Unknown id: service_template default-domain:haproxy-loadbalancer-template 06/02/2025 02:07:44.821 7fad868f2f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:haproxy-loadbalancer-template url = https://10.0.0.129:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-svc-monitor remote_ip = 10.0.0.129 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "haproxy-loadbalancer-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "in-network-nat", "service_type": "loadbalancer", "image_name": null, "service_scaling": true, "interface_type": [{"service_interface_type": "right", "shared_ip": true, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": true, "static_route_enable": false}], "flavor": null, "ordered_interfaces": true, "service_virtualization_type": "network-namespace", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "haproxy-loadbalancer-template"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:44.823 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:device_import_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "device_import_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/device_import.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/topology_discovery.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 1}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"additionalProperties\": false, \"properties\": {\"import_configured\": {\"type\": \"boolean\", \"default\": false, \"description\": \"Not importing configured interfaces by default. Set this option to true if configured interfaces need to be imported.\"}, \"interface_filters\": {\"$id\": \"/properties/interface_filters\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"]}, \"expr\": {\"type\": \"string\"}}, \"title\": \"filter object\", \"description\": \"filter object having op and expr fields\", \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Device Import", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:44.860 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'haproxy-loadbalancer-template'], 'obj_dict': {'display_name': 'haproxy-loadbalancer-template', 'fq_name': ['default-domain', 'haproxy-loadbalancer-template'], 'id_perms': {'created': '2025-06-02T02:07:44.846119', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:44.846119', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11892401965531186970, 'uuid_mslong': 10822340916506411525}}, 'parent_type': 'domain', 'parent_uuid': '283dd1d7-187e-4312-a690-9b0d77dd378d', 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': [{'tenant': 'domain:283dd1d7-187e-4312-a690-9b0d77dd378d', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': None, 'image_name': None, 'instance_data': None, 'interface_type': [{'service_interface_type': 'right', 'shared_ip': True, 'static_route_enable': False}, {'service_interface_type': 'left', 'shared_ip': True, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': 'in-network-nat', 'service_scaling': True, 'service_type': 'loadbalancer', 'service_virtualization_type': 'network-namespace', 'version': 1, 'vrouter_instance_type': None}, 'uuid': '9630adb9-6e8a-4205-a50a-4c9439a4c71a'}, 'oper': 'CREATE', 'request-id': 'req-e296909e-baf8-494a-8154-2365c9e5f5da', 'type': 'service_template', 'uuid': '9630adb9-6e8a-4205-a50a-4c9439a4c71a'} 06/02/2025 02:07:44.917 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'device_import_template'], 'obj_dict': {'display_name': 'Device Import', 'fq_name': ['default-global-system-config', 'device_import_template'], 'id_perms': {'created': '2025-06-02T02:07:44.855333', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:44.855333', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13750270482292081290, 'uuid_mslong': 8591885765633920547}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"additionalProperties": false, ' '"properties": ' '{"import_configured": {"type": ' '"boolean", "default": false, ' '"description": "Not importing ' 'configured interfaces by default. ' 'Set this option to true if ' 'configured interfaces need to be ' 'imported."}, "interface_filters": ' '{"$id": ' '"/properties/interface_filters", ' '"type": "array", "items": {"$id": ' '"/properties/interface_filters/items", ' '"type": "object", "maxProperties": ' '2, "additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"]}, "expr": {"type": ' '"string"}}, "title": "filter ' 'object", "description": "filter ' 'object having op and expr fields", ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 50, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/device_import.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 50, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/topology_discovery.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '773c8295-0358-4e23-bed2-c626ce8f028a'}, 'oper': 'CREATE', 'request-id': 'req-9e78e2ab-ee1c-4467-afe4-311484119c78', 'type': 'job_template', 'uuid': '773c8295-0358-4e23-bed2-c626ce8f028a'} 06/02/2025 02:07:44.937 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'docker-template'] not found in DB: Unknown id: service_template default-domain:docker-template 06/02/2025 02:07:44.938 7fad868f2f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:docker-template url = https://10.0.0.129:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-svc-monitor remote_ip = 10.0.0.129 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "docker-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "transparent", "service_type": "firewall", "image_name": "ubuntu", "service_scaling": false, "interface_type": [{"service_interface_type": "management", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "right", "shared_ip": false, "static_route_enable": false}], "flavor": null, "ordered_interfaces": true, "service_virtualization_type": "vrouter-instance", "availability_zone_enable": false, "vrouter_instance_type": "docker", "instance_data": "{\"command\":\"/bin/bash\"}"}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "docker-template"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:44.980 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'docker-template'], 'obj_dict': {'display_name': 'docker-template', 'fq_name': ['default-domain', 'docker-template'], 'id_perms': {'created': '2025-06-02T02:07:44.956414', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:44.956414', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10965256773716877871, 'uuid_mslong': 13418824552433797590}}, 'parent_type': 'domain', 'parent_uuid': '283dd1d7-187e-4312-a690-9b0d77dd378d', 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': [{'tenant': 'domain:283dd1d7-187e-4312-a690-9b0d77dd378d', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': None, 'image_name': 'ubuntu', 'instance_data': '{"command":"/bin/bash"}', 'interface_type': [{'service_interface_type': 'management', 'shared_ip': False, 'static_route_enable': False}, {'service_interface_type': 'left', 'shared_ip': False, 'static_route_enable': False}, {'service_interface_type': 'right', 'shared_ip': False, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': 'transparent', 'service_scaling': False, 'service_type': 'firewall', 'service_virtualization_type': 'vrouter-instance', 'version': 1, 'vrouter_instance_type': 'docker'}, 'uuid': 'ba393dd5-9f1b-49d6-982c-6af07457222f'}, 'oper': 'CREATE', 'request-id': 'req-0af2a004-7c2e-40cf-a16d-1907f9d09d86', 'type': 'service_template', 'uuid': 'ba393dd5-9f1b-49d6-982c-6af07457222f'} 06/02/2025 02:07:45.022 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'fabric_config_template'] not found in DB: Unknown id: job_template default-global-system-config:fabric_config_template 06/02/2025 02:07:45.043 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:fabric_config_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "fabric_config_template"], "parent_type": "global-system-config", "job_template_type": "config", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/fabric_config.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"device_management_ip\": {\"type\": \"string\", \"description\": \"Management IP of the Device\"}, \"device_abstract_config\": {\"type\": \"object\", \"description\": \"JSON string of the device abstract config derived from VNC data model\"}, \"additional_feature_params\": {\"type\": \"object\", \"additionalProperties\": false, \"description\": \"Additional feature specific parameters that are not defined in the VNC data model. These could be vendor specific parameters.\", \"properties\": {\"basic\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ntp\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ntp_boot_servers\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"title\": \"NTP Boot server\", \"examples\": [\"6.6.6.6\"]}}, \"ntp_servers\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"title\": \"NTP server\", \"examples\": [\"8.8.8.8\"]}}, \"time_zone\": {\"type\": \"string\", \"title\": \"Time Zone\", \"examples\": [\"America/Los_Angeles\"]}}}, \"name_servers\": {\"type\": \"array\", \"additionalProperties\": false, \"items\": {\"type\": \"string\", \"Title\": \"Domain Name Server\", \"examples\": [\"10.1.1.2\", \"11.1.1.2\"]}}, \"domain_name\": {\"type\": \"string\", \"title\": \"Domain Name\", \"examples\": [\"company.net\"]}, \"snmp\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"communities\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\"}, \"readonly\": {\"type\": \"boolean\", \"default\": true}}, \"required\": [\"name\"]}}}}, \"static_routes\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"required\": [\"subnets\", \"nexthop\"], \"properties\": {\"subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"title\": \"Subnet\", \"examples\": [\"10.1.1.0/24\", \"10.1.2.0/24\"]}}, \"nexthop\": {\"type\": \"string\", \"title\": \"Next hop IP\", \"examples\": [\"10.1.1.254\"]}}}}}}, \"underlay_ip_clos\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"bgp_hold_time\": {\"type\": \"integer\", \"default\": 90}}}}}, \"is_delete\": {\"type\": \"boolean\", \"description\": \"Set to true for config delete operation\", \"default\": false}, \"manage_underlay\": {\"type\": \"boolean\", \"description\": \"Set to true to manage underlay config\", \"default\": true}, \"enterprise_style\": {\"type\": \"boolean\", \"description\": \"Set to true to if enterprise-style config\", \"default\": true}, \"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"fabric_uuid\": {\"type\": \"string\", \"format\": \"uuid\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Device Config Push", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:45.118 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_config_template'], 'obj_dict': {'display_name': 'Device Config Push', 'fq_name': ['default-global-system-config', 'fabric_config_template'], 'id_perms': {'created': '2025-06-02T02:07:45.060501', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:45.060501', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12271581112353455521, 'uuid_mslong': 13272740194049016181}}, 'job_template_concurrency_level': 'device', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": ' '{"device_management_ip": {"type": ' '"string", "description": ' '"Management IP of the Device"}, ' '"device_abstract_config": {"type": ' '"object", "description": "JSON ' 'string of the device abstract ' 'config derived from VNC data ' 'model"}, ' '"additional_feature_params": ' '{"type": "object", ' '"additionalProperties": false, ' '"description": "Additional feature ' 'specific parameters that are not ' 'defined in the VNC data model. ' 'These could be vendor specific ' 'parameters.", "properties": ' '{"basic": {"type": "object", ' '"additionalProperties": false, ' '"properties": {"ntp": {"type": ' '"object", "additionalProperties": ' 'false, "properties": ' '{"ntp_boot_servers": {"type": ' '"array", "items": {"type": ' '"string", "title": "NTP Boot ' 'server", "examples": ' '["6.6.6.6"]}}, "ntp_servers": ' '{"type": "array", "items": ' '{"type": "string", "title": "NTP ' 'server", "examples": ' '["8.8.8.8"]}}, "time_zone": ' '{"type": "string", "title": "Time ' 'Zone", "examples": ' '["America/Los_Angeles"]}}}, ' '"name_servers": {"type": "array", ' '"additionalProperties": false, ' '"items": {"type": "string", ' '"Title": "Domain Name Server", ' '"examples": ["10.1.1.2", ' '"11.1.1.2"]}}, "domain_name": ' '{"type": "string", "title": ' '"Domain Name", "examples": ' '["company.net"]}, "snmp": {"type": ' '"object", "additionalProperties": ' 'false, "properties": ' '{"communities": {"type": "array", ' '"items": {"type": "object", ' '"additionalProperties": false, ' '"properties": {"name": {"type": ' '"string"}, "readonly": {"type": ' '"boolean", "default": true}}, ' '"required": ["name"]}}}}, ' '"static_routes": {"type": "array", ' '"items": {"type": "object", ' '"additionalProperties": false, ' '"required": ["subnets", ' '"nexthop"], "properties": ' '{"subnets": {"type": "array", ' '"items": {"type": "string", ' '"title": "Subnet", "examples": ' '["10.1.1.0/24", "10.1.2.0/24"]}}, ' '"nexthop": {"type": "string", ' '"title": "Next hop IP", ' '"examples": ["10.1.1.254"]}}}}}}, ' '"underlay_ip_clos": {"type": ' '"object", "additionalProperties": ' 'false, "properties": ' '{"bgp_hold_time": {"type": ' '"integer", "default": 90}}}}}, ' '"is_delete": {"type": "boolean", ' '"description": "Set to true for ' 'config delete operation", ' '"default": false}, ' '"manage_underlay": {"type": ' '"boolean", "description": "Set to ' 'true to manage underlay config", ' '"default": true}, ' '"enterprise_style": {"type": ' '"boolean", "description": "Set to ' 'true to if enterprise-style ' 'config", "default": true}, ' '"fabric_fq_name": {"type": ' '"array", "items": {"type": ' '"string"}}, "fabric_uuid": ' '{"type": "string", "format": ' '"uuid"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/fabric_config.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'config', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b8323ee2-6e57-4175-aa4d-6a010a387da1'}, 'oper': 'CREATE', 'request-id': 'req-825e607c-7869-4852-9846-527a074dbdc9', 'type': 'job_template', 'uuid': 'b8323ee2-6e57-4175-aa4d-6a010a387da1'} 06/02/2025 02:07:45.213 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ztp_template'] not found in DB: Unknown id: job_template default-global-system-config:ztp_template 06/02/2025 02:07:45.220 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:ztp_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "ztp_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/ztp.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"device_count\": {\"$id\": \"/properties/input/properties/device_count\", \"type\": \"integer\", \"title\": \"The Device Count Schema\", \"description\": \"Number of devices to discover\", \"default\": 0, \"examples\": [1, 2, 3, 4, 5]}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "ZTP", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:45.301 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ztp_template'], 'obj_dict': {'display_name': 'ZTP', 'fq_name': ['default-global-system-config', 'ztp_template'], 'id_perms': {'created': '2025-06-02T02:07:45.242068', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:45.242068', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10268974063108890851, 'uuid_mslong': 269137630268508954}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"properties": {"fabric_uuid": ' '{"$id": ' '"/properties/input/properties/fabric_uuid", ' '"format": "uuid", "type": ' '"string", "title": "The ' 'Fabric_uuid Schema", ' '"description": "UUID of the fabric ' 'object created", "default": "", ' '"examples": ["123456789"]}, ' '"device_count": {"$id": ' '"/properties/input/properties/device_count", ' '"type": "integer", "title": "The ' 'Device Count Schema", ' '"description": "Number of devices ' 'to discover", "default": 0, ' '"examples": [1, 2, 3, 4, 5]}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': ''}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '03bc2b3f-afd8-4b1a-8e82-b980c74e20e3'}, 'oper': 'CREATE', 'request-id': 'req-f5822810-9c05-4723-b9c5-6eb96845daef', 'type': 'job_template', 'uuid': '03bc2b3f-afd8-4b1a-8e82-b980c74e20e3'} 06/02/2025 02:07:45.409 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'fabric_deletion_template'] not found in DB: Unknown id: job_template default-global-system-config:fabric_deletion_template 06/02/2025 02:07:45.418 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:fabric_deletion_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "fabric_deletion_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/delete_fabric.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Fabric Deletion", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:45.504 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_deletion_template'], 'obj_dict': {'display_name': 'Fabric Deletion', 'fq_name': ['default-global-system-config', 'fabric_deletion_template'], 'id_perms': {'created': '2025-06-02T02:07:45.436313', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:45.436313', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10136424330325996578, 'uuid_mslong': 16041574627406136846}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name"], ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/delete_fabric.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'de9f1f21-b876-460e-8cab-d0392db53422'}, 'oper': 'CREATE', 'request-id': 'req-463ccd34-7acb-4354-b47f-85ed9b5ef94c', 'type': 'job_template', 'uuid': 'de9f1f21-b876-460e-8cab-d0392db53422'} 06/02/2025 02:07:45.605 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'device_deletion_template'] not found in DB: Unknown id: job_template default-global-system-config:device_deletion_template 06/02/2025 02:07:45.610 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:device_deletion_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "device_deletion_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/delete_fabric_devices.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": 0}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"devices\": {\"type\": \"array\", \"description\": \"List of device names\", \"items\": {\"type\": \"string\"}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Device Deletion", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:45.708 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'device_deletion_template'], 'obj_dict': {'display_name': 'Device Deletion', 'fq_name': ['default-global-system-config', 'device_deletion_template'], 'id_perms': {'created': '2025-06-02T02:07:45.626173', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:45.626173', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12020521503024539756, 'uuid_mslong': 11014619189339113045}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name"], ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, "devices": ' '{"type": "array", "description": ' '"List of device names", "items": ' '{"type": "string"}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/delete_fabric_devices.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '98dbc9cb-74c2-4655-a6d1-789e9ab8e86c'}, 'oper': 'CREATE', 'request-id': 'req-609c9b22-9466-4493-88fe-caac4cbc08b9', 'type': 'job_template', 'uuid': '98dbc9cb-74c2-4655-a6d1-789e9ab8e86c'} 06/02/2025 02:07:45.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:45.830 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'role_assignment_template'] not found in DB: Unknown id: job_template default-global-system-config:role_assignment_template 06/02/2025 02:07:45.845 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:role_assignment_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "role_assignment_template"], "parent_type": "global-system-config", "job_template_type": "config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/role_assignment.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\", \"role_assignments\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"role_assignments\": {\"type\": \"array\", \"minItems\": 0, \"description\": \"Fabric device role assignments\", \"items\": {\"type\": \"object\", \"properties\": {\"device_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"physical_role\": {\"type\": \"string\", \"enum\": [\"leaf\", \"spine\", \"pnf\", \"superspine\"]}, \"routing_switching_roles\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"enum\": [\"CRB\"]}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Role Assignment", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:45.940 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'role_assignment_template'], 'obj_dict': {'display_name': 'Role Assignment', 'fq_name': ['default-global-system-config', 'role_assignment_template'], 'id_perms': {'created': '2025-06-02T02:07:45.886046', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:45.886046', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13706897822333418847, 'uuid_mslong': 7186949353943551838}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name", ' '"role_assignments"], "properties": ' '{"fabric_fq_name": {"type": ' '"array", "items": {"type": ' '"string"}}, "role_assignments": ' '{"type": "array", "minItems": 0, ' '"description": "Fabric device role ' 'assignments", "items": {"type": ' '"object", "properties": ' '{"device_fq_name": {"type": ' '"array", "items": {"type": ' '"string"}}, "physical_role": ' '{"type": "string", "enum": ' '["leaf", "spine", "pnf", ' '"superspine"]}, ' '"routing_switching_roles": ' '{"type": "array", "items": ' '{"type": "string", "enum": ' '["CRB"]}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/role_assignment.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'config', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '63bd2c5b-fc87-4f5e-be38-aef278c23d5f'}, 'oper': 'CREATE', 'request-id': 'req-7f713364-825c-4675-80d0-d0a8d08fee6e', 'type': 'job_template', 'uuid': '63bd2c5b-fc87-4f5e-be38-aef278c23d5f'} 06/02/2025 02:07:46.131 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'topology_discovery_template'] not found in DB: Unknown id: job_template default-global-system-config:topology_discovery_template 06/02/2025 02:07:46.179 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:topology_discovery_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "topology_discovery_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/topology_discovery.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Topology Discovery", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:46.346 7fad88a75cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_DNS_refs in resource network-ipam: 'virtual_DNS_refs' 06/02/2025 02:07:46.346 7fad88a75cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource network-ipam: 'tag_refs' 06/02/2025 02:07:46.346 7fad88a75cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_network_back_refs in resource network-ipam: 'virtual_network_back_refs' 06/02/2025 02:07:46.346 7fad88a75cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_router_back_refs in resource network-ipam: 'virtual_router_back_refs' 06/02/2025 02:07:46.347 7fad88a75cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource network-ipam: 'instance_ip_back_refs' 06/02/2025 02:07:46.362 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'topology_discovery_template'], 'obj_dict': {'display_name': 'Topology Discovery', 'fq_name': ['default-global-system-config', 'topology_discovery_template'], 'id_perms': {'created': '2025-06-02T02:07:46.259954', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:46.259954', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9971915516751467930, 'uuid_mslong': 5827908181651768859}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/topology_discovery.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '50e0e39d-16f2-461b-8a63-5c543a2d559a'}, 'oper': 'CREATE', 'request-id': 'req-75cae410-17e3-4b70-ba9a-0e33be2d5af2', 'type': 'job_template', 'uuid': '50e0e39d-16f2-461b-8a63-5c543a2d559a'} 06/02/2025 02:07:46.489 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 06/02/2025 02:07:46.490 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 06/02/2025 02:07:46.490 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 06/02/2025 02:07:46.490 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 06/02/2025 02:07:46.490 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 06/02/2025 02:07:46.490 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 06/02/2025 02:07:46.490 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 06/02/2025 02:07:46.490 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 06/02/2025 02:07:46.490 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 06/02/2025 02:07:46.491 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 06/02/2025 02:07:46.491 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 06/02/2025 02:07:46.491 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 06/02/2025 02:07:46.491 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 06/02/2025 02:07:46.491 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 06/02/2025 02:07:46.491 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 06/02/2025 02:07:46.491 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 06/02/2025 02:07:46.491 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 06/02/2025 02:07:46.491 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 06/02/2025 02:07:46.491 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 06/02/2025 02:07:46.491 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 06/02/2025 02:07:46.491 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 06/02/2025 02:07:46.491 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 06/02/2025 02:07:46.492 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 06/02/2025 02:07:46.492 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 06/02/2025 02:07:46.492 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 06/02/2025 02:07:46.492 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 06/02/2025 02:07:46.492 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 06/02/2025 02:07:46.492 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 06/02/2025 02:07:46.492 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 06/02/2025 02:07:46.492 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 06/02/2025 02:07:46.492 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 06/02/2025 02:07:46.492 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 06/02/2025 02:07:46.492 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 06/02/2025 02:07:46.492 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 06/02/2025 02:07:46.495 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'fabric_onboard_template'] not found in DB: Unknown id: job_template default-global-system-config:fabric_onboard_template 06/02/2025 02:07:46.507 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:fabric_onboard_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "fabric_onboard_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/fabric_onboard.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 5, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/ztp.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 1}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_device.yml", "multi_device_playbook": false, "refresh_token": true, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 2}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 3}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 4}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/role_assignment_dfg.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 5, "sequence_no": 5}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_role.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 5, "sequence_no": 6}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 5, "sequence_no": 7}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/device_import.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 8}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/topology_discovery.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 9}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 5, "sequence_no": 10}]}, "job_template_recovery_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": null, "device_family": null, "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\", \"management_subnets\", \"loopback_subnets\", \"fabric_subnets\", \"fabric_asn_pool\", \"device_auth\", \"node_profiles\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"fabric_display_name\": {\"type\": \"string\"}, \"fabric_cluster_id\": {\"type\": \"integer\"}, \"management_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"description\": \"List of the management network subnets for the fabric\", \"additionalProperties\": false, \"required\": [\"cidr\", \"gateway\"], \"properties\": {\"cidr\": {\"type\": \"string\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}, \"gateway\": {\"type\": \"string\", \"format\": \"ipv4\"}}}}, \"loopback_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that fabric device loopback ips can be allocated.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"overlay_loopback_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that fabric device overlay loopback ips can be allocated.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"fabric_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that could be carved out for the p2p networks between fabric devices.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"pnf_servicechain_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that could be carved out for service chaining between fabric devices.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"fabric_asn_pool\": {\"type\": \"array\", \"items\": {\"title\": \"eBGP ASN Pool for fabric underlay network\", \"type\": \"object\", \"description\": \"List of the ASN pools that could be used to configure the eBGP peers for the IP fabric\", \"properties\": {\"asn_min\": {\"type\": \"integer\"}, \"asn_max\": {\"type\": \"integer\"}}, \"required\": [\"asn_min\", \"asn_max\"]}}, \"overlay_ibgp_asn\": {\"type\": \"integer\", \"title\": \"iBGP ASN for Contrail overlay network\", \"default\": 64512}, \"device_auth\": {\"title\": \"Device Auth\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"root_password\"], \"properties\": {\"root_password\": {\"type\": \"string\"}}}, \"node_profiles\": {\"type\": \"array\", \"items\": {\"title\": \"Node profile\", \"type\": \"object\", \"description\": \"List of node profiles to be used by the fabric.\", \"additionalProperties\": false, \"properties\": {\"node_profile_name\": {\"type\": \"string\"}, \"serial_nums\": {\"type\": \"array\", \"description\": \"Optional list of serial numbers of fabric devices that we want to associate with this node profile.\", \"items\": {\"type\": \"string\"}}}, \"required\": [\"node_profile_name\"]}}, \"interface_filters\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"]}, \"expr\": {\"type\": \"string\"}}, \"title\": \"filter object\", \"description\": \"filter object having op and expr fields\", \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}, \"import_configured\": {\"type\": \"boolean\", \"default\": false, \"description\": \"Not importing configured interfaces by default. Set this option to true if configured interfaces need to be imported as part of onboarding.\"}, \"device_count\": {\"title\": \"Number of fabric devices\", \"type\": \"integer\", \"description\": \"Total number of devices in the fabric that needs to be zero-touch provisioned\"}, \"ztp_timeout\": {\"title\": \"Value of ZTP timeout in seconds\", \"type\": \"integer\", \"description\": \"Value of ZTP timeout in seconds\"}, \"retry_timeout\": {\"title\": \"Value of retry timeout in seconds\", \"type\": \"integer\", \"description\": \"Value of retry timeout in seconds\"}, \"supplemental_day_0_cfg\": {\"title\": \"List of day 0 config that can be used to supplement the ZTP config\", \"type\": \"array\", \"items\": {\"type\": \"object\", \"required\": [\"name\", \"cfg\"], \"properties\": {\"name\": {\"title\": \"name for the config\", \"type\": \"string\"}, \"cfg\": {\"title\": \"config blob that contains the supplemental day-0 config\", \"type\": \"string\"}}}}, \"device_to_ztp\": {\"title\": \"List of device serial numbers for the devices to be ZTPed\", \"type\": \"array\", \"items\": {\"type\": \"object\", \"required\": [\"serial_number\", \"hostname\"], \"properties\": {\"serial_number\": {\"title\": \"Device serial number\", \"type\": \"string\"}, \"hostname\": {\"title\": \"Device hostname can be optionally specified.\", \"type\": \"string\", \"pattern\": \"^(([a-zA-Z0-9]|[a-zA-Z0-9][a-zA-Z0-9\\\\-]*[a-zA-Z0-9])\\\\.)*([A-Za-z0-9]|[A-Za-z0-9][A-Za-z0-9\\\\-]*[A-Za-z0-9])$\"}, \"underlay_asn\": {\"title\": \"Underlay eBGP autonomous system number\", \"type\": [\"integer\", \"string\"]}, \"loopback_ip\": {\"title\": \"Loopback IP address\", \"type\": \"string\", \"format\": \"ipv4\"}, \"mgmt_ip\": {\"title\": \"Management IP address\", \"type\": \"string\", \"format\": \"ipv4\"}, \"to_ztp\": {\"title\": \"Include or ignore device in ZTP workflow\", \"type\": \"boolean\"}, \"supplemental_day_0_cfg\": {\"title\": \"Name(s) of the supplemental day-0 config(s) that can be optionally specified for this device\", \"type\": [\"string\", \"array\"], \"items\": {\"type\": \"string\"}}}}}, \"os_version\": {\"type\": \"string\"}, \"enterprise_style\": {\"type\": \"boolean\", \"default\": true, \"description\": \"True if enterprise style, false if sp-style configuration\"}, \"disable_vlan_vn_uniqueness_check\": {\"type\": \"boolean\", \"default\": false, \"description\": \"True if vlan-vn uniqueness validation checks needs to be disabled, false if enable all complex validations\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Fabric Onboarding", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:46.591 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_onboard_template'], 'obj_dict': {'display_name': 'Fabric Onboarding', 'fq_name': ['default-global-system-config', 'fabric_onboard_template'], 'id_perms': {'created': '2025-06-02T02:07:46.525044', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:46.525044', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13827347916991855945, 'uuid_mslong': 3436901219288105157}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name", ' '"management_subnets", ' '"loopback_subnets", ' '"fabric_subnets", ' '"fabric_asn_pool", "device_auth", ' '"node_profiles"], "properties": ' '{"fabric_fq_name": {"type": ' '"array", "items": {"type": ' '"string"}}, "fabric_display_name": ' '{"type": "string"}, ' '"fabric_cluster_id": {"type": ' '"integer"}, "management_subnets": ' '{"type": "array", "items": ' '{"type": "object", "description": ' '"List of the management network ' 'subnets for the fabric", ' '"additionalProperties": false, ' '"required": ["cidr", "gateway"], ' '"properties": {"cidr": {"type": ' '"string", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}, ' '"gateway": {"type": "string", ' '"format": "ipv4"}}}}, ' '"loopback_subnets": {"type": ' '"array", "items": {"type": ' '"string", "description": "List of ' 'the subnet prefixes that fabric ' 'device loopback ips can be ' 'allocated.", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"overlay_loopback_subnets": ' '{"type": "array", "items": ' '{"type": "string", "description": ' '"List of the subnet prefixes that ' 'fabric device overlay loopback ips ' 'can be allocated.", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"fabric_subnets": {"type": ' '"array", "items": {"type": ' '"string", "description": "List of ' 'the subnet prefixes that could be ' 'carved out for the p2p networks ' 'between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"pnf_servicechain_subnets": ' '{"type": "array", "items": ' '{"type": "string", "description": ' '"List of the subnet prefixes that ' 'could be carved out for service ' 'chaining between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"fabric_asn_pool": {"type": ' '"array", "items": {"title": "eBGP ' 'ASN Pool for fabric underlay ' 'network", "type": "object", ' '"description": "List of the ASN ' 'pools that could be used to ' 'configure the eBGP peers for the ' 'IP fabric", "properties": ' '{"asn_min": {"type": "integer"}, ' '"asn_max": {"type": "integer"}}, ' '"required": ["asn_min", ' '"asn_max"]}}, "overlay_ibgp_asn": ' '{"type": "integer", "title": "iBGP ' 'ASN for Contrail overlay network", ' '"default": 64512}, "device_auth": ' '{"title": "Device Auth", "type": ' '"object", "additionalProperties": ' 'false, "required": ' '["root_password"], "properties": ' '{"root_password": {"type": ' '"string"}}}, "node_profiles": ' '{"type": "array", "items": ' '{"title": "Node profile", "type": ' '"object", "description": "List of ' 'node profiles to be used by the ' 'fabric.", "additionalProperties": ' 'false, "properties": ' '{"node_profile_name": {"type": ' '"string"}, "serial_nums": {"type": ' '"array", "description": "Optional ' 'list of serial numbers of fabric ' 'devices that we want to associate ' 'with this node profile.", "items": ' '{"type": "string"}}}, "required": ' '["node_profile_name"]}}, ' '"interface_filters": {"type": ' '"array", "items": {"type": ' '"object", "maxProperties": 2, ' '"additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"]}, "expr": {"type": ' '"string"}}, "title": "filter ' 'object", "description": "filter ' 'object having op and expr fields", ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}, ' '"import_configured": {"type": ' '"boolean", "default": false, ' '"description": "Not importing ' 'configured interfaces by default. ' 'Set this option to true if ' 'configured interfaces need to be ' 'imported as part of onboarding."}, ' '"device_count": {"title": "Number ' 'of fabric devices", "type": ' '"integer", "description": "Total ' 'number of devices in the fabric ' 'that needs to be zero-touch ' 'provisioned"}, "ztp_timeout": ' '{"title": "Value of ZTP timeout in ' 'seconds", "type": "integer", ' '"description": "Value of ZTP ' 'timeout in seconds"}, ' '"retry_timeout": {"title": "Value ' 'of retry timeout in seconds", ' '"type": "integer", "description": ' '"Value of retry timeout in ' 'seconds"}, ' '"supplemental_day_0_cfg": ' '{"title": "List of day 0 config ' 'that can be used to supplement the ' 'ZTP config", "type": "array", ' '"items": {"type": "object", ' '"required": ["name", "cfg"], ' '"properties": {"name": {"title": ' '"name for the config", "type": ' '"string"}, "cfg": {"title": ' '"config blob that contains the ' 'supplemental day-0 config", ' '"type": "string"}}}}, ' '"device_to_ztp": {"title": "List ' 'of device serial numbers for the ' 'devices to be ZTPed", "type": ' '"array", "items": {"type": ' '"object", "required": ' '["serial_number", "hostname"], ' '"properties": {"serial_number": ' '{"title": "Device serial number", ' '"type": "string"}, "hostname": ' '{"title": "Device hostname can be ' 'optionally specified.", "type": ' '"string", "pattern": ' '"^(([a-zA-Z0-9]|[a-zA-Z0-9][a-zA-Z0-9\\\\-]*[a-zA-Z0-9])\\\\.)*([A-Za-z0-9]|[A-Za-z0-9][A-Za-z0-9\\\\-]*[A-Za-z0-9])$"}, ' '"underlay_asn": {"title": ' '"Underlay eBGP autonomous system ' 'number", "type": ["integer", ' '"string"]}, "loopback_ip": ' '{"title": "Loopback IP address", ' '"type": "string", "format": ' '"ipv4"}, "mgmt_ip": {"title": ' '"Management IP address", "type": ' '"string", "format": "ipv4"}, ' '"to_ztp": {"title": "Include or ' 'ignore device in ZTP workflow", ' '"type": "boolean"}, ' '"supplemental_day_0_cfg": ' '{"title": "Name(s) of the ' 'supplemental day-0 config(s) that ' 'can be optionally specified for ' 'this device", "type": ["string", ' '"array"], "items": {"type": ' '"string"}}}}}, "os_version": ' '{"type": "string"}, ' '"enterprise_style": {"type": ' '"boolean", "default": true, ' '"description": "True if enterprise ' 'style, false if sp-style ' 'configuration"}, ' '"disable_vlan_vn_uniqueness_check": ' '{"type": "boolean", "default": ' 'false, "description": "True if ' 'vlan-vn uniqueness validation ' 'checks needs to be disabled, false ' 'if enable all complex ' 'validations"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/fabric_onboard.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_device.yml', 'refresh_token': True, 'sequence_no': 2, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml', 'refresh_token': False, 'sequence_no': 3, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml', 'refresh_token': False, 'sequence_no': 4, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/role_assignment_dfg.yml', 'refresh_token': False, 'sequence_no': 5, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_role.yml', 'refresh_token': False, 'sequence_no': 6, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml', 'refresh_token': False, 'sequence_no': 7, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/device_import.yml', 'refresh_token': False, 'sequence_no': 8, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/topology_discovery.yml', 'refresh_token': False, 'sequence_no': 9, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': 10, 'vendor': 'Juniper'}]}, 'job_template_recovery_playbooks': {'playbook_info': [{'device_family': None, 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': None}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2fb25373-0fc6-40c5-bfe4-9bab8a097d49'}, 'oper': 'CREATE', 'request-id': 'req-d6b2d804-2655-4035-a4d4-798e2c8d7252', 'type': 'job_template', 'uuid': '2fb25373-0fc6-40c5-bfe4-9bab8a097d49'} 06/02/2025 02:07:46.613 7fad85c6b588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'] not found in DB: Unknown id: analytics_snmp_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 06/02/2025 02:07:46.625 7fad85c6b588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.129 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.129", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:46.670 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.129', 'display_name': 'cn-jenkins-deploy-platform-juju-os-542-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'id_perms': {'created': '2025-06-02T02:07:46.661545', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:46.661545', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13621128556995425995, 'uuid_mslong': 6986561550497958125}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '60f540b6-bad5-48ed-bd07-f84137a436cb'}, 'oper': 'CREATE', 'request-id': 'req-b2b70add-406e-42d6-ad41-0e4dda878a78', 'type': 'analytics_snmp_node', 'uuid': '60f540b6-bad5-48ed-bd07-f84137a436cb'} 06/02/2025 02:07:46.670 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 06/02/2025 02:07:46.671 7fad85c648d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:46.671 7fad85c648d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 elements = { analytics_snmp_node_ip_address : "10.0.0.129"display_name : "cn-jenkins-deploy-platform-juju-os-542-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 6986561550497958125, "uuid_lslong": 13621128556995425995}, "enable": true, "created": "2025-06-02T02:07:46.661545", "last_modified": "2025-06-02T02:07:46.661545", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3b45d35b-de57-4285-b542-427e524b5c84"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "60f540b6-bad5-48ed-bd07-f84137a436cb" } deleted = False >> 06/02/2025 02:07:46.671 7fad85c648d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:46.685 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'search_ip_mac_template'] not found in DB: Unknown id: job_template default-global-system-config:search_ip_mac_template 06/02/2025 02:07:46.694 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:search_ip_mac_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "search_ip_mac_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ip_address\": {\"$id\": \"/properties/ip_address\", \"title\": \"IP Address\", \"pattern\": \"^\\\\s*(([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5]).){3}([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5])\\\\s*$\", \"type\": \"string\"}, \"mac_address\": {\"$id\": \"/properties/mac_address\", \"title\": \"Mac Address\", \"pattern\": \"^\\\\s*([A-Fa-f0-9]{2}(:{1}[A-Fa-f0-9]{2}){5})\\\\s*$\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Search ip or mac schema command Playbook Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"interface_names\": {\"type\": \"array\", \"title\": \"Interfaces Name(s)\", \"description\": \"Display Interface Names that belong to this mac_address.\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface Name\", \"description\": \"Interface name\"}, \"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"Device name on which the interface was learnt\"}, \"loopback_ip\": {\"type\": \"string\", \"title\": \"Source Loopback IP\", \"description\": \"Originating source's loopback ip address\"}}, \"description\": \"Name of each interface that belongs under this mac_address\"}}}}}}}}}", "job_template_input_ui_schema": "{\"ip_address\": {\"ui:help\": \"Enter an IP Address. The field value must include a IPv4 address without subnet mask; for example, 192.168.3.120\", \"ui:placeholder\": \"Enter IP address\"}, \"mac_address\": {\"ui:help\": \"Enter a 48 bit MAC address in colon separated format; for example, 00:00:0A:BB:28:FC\", \"ui:placeholder\": \"Enter MAC address\"}}", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to locate an interface in a fabric given an IP or MAC", "display_name": "Search using IP or MAC", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:46.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:46.799 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'search_ip_mac_template'], 'obj_dict': {'display_name': 'Search using IP or MAC', 'fq_name': ['default-global-system-config', 'search_ip_mac_template'], 'id_perms': {'created': '2025-06-02T02:07:46.730130', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:46.730130', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13719354055395857263, 'uuid_mslong': 10376427940293069788}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to locate an ' 'interface in a fabric given an IP ' 'or MAC', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"ip_address": ' '{"$id": "/properties/ip_address", ' '"title": "IP Address", "pattern": ' '"^\\\\s*(([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5]).){3}([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5])\\\\s*$", ' '"type": "string"}, "mac_address": ' '{"$id": "/properties/mac_address", ' '"title": "Mac Address", "pattern": ' '"^\\\\s*([A-Fa-f0-9]{2}(:{1}[A-Fa-f0-9]{2}){5})\\\\s*$", ' '"type": "string"}}}', 'job_template_input_ui_schema': '{"ip_address": {"ui:help": ' '"Enter an IP Address. The field ' 'value must include a IPv4 ' 'address without subnet mask; ' 'for example, 192.168.3.120", ' '"ui:placeholder": "Enter IP ' 'address"}, "mac_address": ' '{"ui:help": "Enter a 48 bit MAC ' 'address in colon separated ' 'format; for example, ' '00:00:0A:BB:28:FC", ' '"ui:placeholder": "Enter MAC ' 'address"}}', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Search ip or mac schema ' 'command Playbook Output", "type": ' '"object", "properties": ' '{"results": {"type": "array", ' '"description": "Array holding the ' 'specific output details in case ' 'of success. Each object of the ' 'array would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"interface_names": {"type": ' '"array", "title": "Interfaces ' 'Name(s)", "description": "Display ' 'Interface Names that belong to ' 'this mac_address.", "items": ' '{"type": "object", ' '"additionalProperties": false, ' '"properties": {"name": {"type": ' '"string", "title": "Interface ' 'Name", "description": "Interface ' 'name"}, "device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "Device name on ' 'which the interface was learnt"}, ' '"loopback_ip": {"type": "string", ' '"title": "Source Loopback IP", ' '"description": "Originating ' 'source\'s loopback ip address"}}, ' '"description": "Name of each ' 'interface that belongs under this ' 'mac_address"}}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '90007a3c-2a9b-4bdc-be64-efd33baf536f'}, 'oper': 'CREATE', 'request-id': 'req-cf3f014d-8714-4ea4-8389-b7f7adad9982', 'type': 'job_template', 'uuid': '90007a3c-2a9b-4bdc-be64-efd33baf536f'} 06/02/2025 02:07:46.900 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'show_interface_details_template'] not found in DB: Unknown id: job_template default-global-system-config:show_interface_details_template 06/02/2025 02:07:46.910 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_interface_details_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_interface_details_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"interface_details\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"Interface Details\", \"type\": \"object\", \"properties\": {\"interface_type\": {\"type\": \"string\", \"title\": \"Interface Type\", \"enum\": [\"physical\", \"logical\"], \"default\": \"physical\"}}, \"required\": [\"interface_type\"]}, \"conditional\": {\"title\": \"Sub Operation Type\", \"$ref\": \"#/definitions/sub_command\"}}, \"definitions\": {\"sub_command\": {\"title\": \"Sub Operation Type\", \"type\": \"object\", \"properties\": {\"sub_operation\": {\"title\": \"Choose a sub-operation\", \"type\": \"string\", \"enum\": [\"Show runtime interfaces\", \"Show configured interfaces\", \"Show interfaces by names\"], \"default\": \"Show runtime interfaces\"}}, \"required\": [\"sub_operation\"], \"dependencies\": {\"sub_operation\": {\"oneOf\": [{\"properties\": {\"sub_operation\": {\"enum\": [\"Show runtime interfaces\"]}, \"interface_filters\": {\"$id\": \"/properties/interface_filters\", \"title\": \"Interface Filters\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"title\": \"Filter\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"], \"title\": \"Filter Type\"}, \"expr\": {\"type\": \"string\", \"title\": \"Filter Expression\"}}, \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"Show configured interfaces\"]}, \"interface_filters\": {\"$id\": \"/properties/interface_filters\", \"title\": \"Interface Filters\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"title\": \"Filter\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"], \"title\": \"Filter Type\"}, \"expr\": {\"type\": \"string\", \"title\": \"Filter Expression\"}}, \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"Show interfaces by names\"]}, \"interface_names\": {\"$id\": \"/properties/interface_names\", \"title\": \"Interface Names\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_names/items\", \"type\": \"string\", \"pattern\": \"^([a-z]{1,}[0-9]{0,}(-[0-9]{1,}/[0-9]{1,}/[0-9]{1,})?(\\\\.[0-9]{1,})?)$\", \"title\": \"Interface Name\"}, \"examples\": [\"ge-0/0/1\", \"xe-0/0/0\"]}}, \"required\": [\"interface_names\"]}]}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show Interface Details Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces details sub-command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"oneOf\": [{\"properties\": {\"interface_stats_rt_phy\": {\"type\": \"array\", \"title\": \"Runtime Physical Interfaces Statistics\", \"description\": \"Display statistics and detailed output\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface\", \"description\": \"Interface name\"}, \"op_status\": {\"type\": \"string\", \"title\": \"Operational Status\", \"description\": \"Operational status of the interface\"}, \"admin_status\": {\"type\": \"string\", \"title\": \"Admin Status\", \"description\": \"Admin status of the interface\"}, \"input_rate\": {\"type\": \"string\", \"title\": \"InputRate (bps)\", \"description\": \"Input packets rate in bits per second if present\"}, \"output_rate\": {\"type\": \"string\", \"title\": \"OutputRate (bps)\", \"description\": \"Output packets rate in bits per second if present\"}}}}}}, {\"properties\": {\"interface_stats_log\": {\"type\": \"array\", \"title\": \"Logical Interfaces Statistics\", \"description\": \"Display statistics and detailed output\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface\", \"description\": \"Interface name\"}, \"address_family\": {\"type\": \"string\", \"title\": \"Address Family\", \"description\": \"Address family if present\"}}}}}}, {\"properties\": {\"interface_stats_cf_phy\": {\"type\": \"array\", \"title\": \"Configured Physical Interfaces Statistics\", \"description\": \"Display statistics and detailed output\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface\", \"description\": \"Interface name\"}}}}}}]}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to get a list of physical or logical interfaces from a device and interfaces' other related information.", "display_name": "Show Interface Details", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:46.995 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'show_interface_details_template'], 'obj_dict': {'display_name': 'Show Interface Details', 'fq_name': ['default-global-system-config', 'show_interface_details_template'], 'id_perms': {'created': '2025-06-02T02:07:46.934466', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:46.934466', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11759970960491415693, 'uuid_mslong': 13823268246162194951}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to get a list ' 'of physical or logical interfaces ' "from a device and interfaces' other " 'related information.', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": ' '{"interface_details": {"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "Interface Details", ' '"type": "object", "properties": ' '{"interface_type": {"type": ' '"string", "title": "Interface ' 'Type", "enum": ["physical", ' '"logical"], "default": ' '"physical"}}, "required": ' '["interface_type"]}, ' '"conditional": {"title": "Sub ' 'Operation Type", "$ref": ' '"#/definitions/sub_command"}}, ' '"definitions": {"sub_command": ' '{"title": "Sub Operation Type", ' '"type": "object", "properties": ' '{"sub_operation": {"title": ' '"Choose a sub-operation", "type": ' '"string", "enum": ["Show runtime ' 'interfaces", "Show configured ' 'interfaces", "Show interfaces by ' 'names"], "default": "Show runtime ' 'interfaces"}}, "required": ' '["sub_operation"], "dependencies": ' '{"sub_operation": {"oneOf": ' '[{"properties": {"sub_operation": ' '{"enum": ["Show runtime ' 'interfaces"]}, ' '"interface_filters": {"$id": ' '"/properties/interface_filters", ' '"title": "Interface Filters", ' '"type": "array", "items": {"$id": ' '"/properties/interface_filters/items", ' '"type": "object", "title": ' '"Filter", "maxProperties": 2, ' '"additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"], "title": "Filter ' 'Type"}, "expr": {"type": "string", ' '"title": "Filter Expression"}}, ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["Show configured ' 'interfaces"]}, ' '"interface_filters": {"$id": ' '"/properties/interface_filters", ' '"title": "Interface Filters", ' '"type": "array", "items": {"$id": ' '"/properties/interface_filters/items", ' '"type": "object", "title": ' '"Filter", "maxProperties": 2, ' '"additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"], "title": "Filter ' 'Type"}, "expr": {"type": "string", ' '"title": "Filter Expression"}}, ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["Show interfaces by ' 'names"]}, "interface_names": ' '{"$id": ' '"/properties/interface_names", ' '"title": "Interface Names", ' '"type": "array", "items": {"$id": ' '"/properties/interface_names/items", ' '"type": "string", "pattern": ' '"^([a-z]{1,}[0-9]{0,}(-[0-9]{1,}/[0-9]{1,}/[0-9]{1,})?(\\\\.[0-9]{1,})?)$", ' '"title": "Interface Name"}, ' '"examples": ["ge-0/0/1", ' '"xe-0/0/0"]}}, "required": ' '["interface_names"]}]}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show Interface Details ' 'Output", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces details ' 'sub-command executed on the ' 'device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "oneOf": ' '[{"properties": ' '{"interface_stats_rt_phy": ' '{"type": "array", "title": ' '"Runtime Physical Interfaces ' 'Statistics", "description": ' '"Display statistics and detailed ' 'output", "items": {"type": ' '"object", "additionalProperties": ' 'false, "properties": {"name": ' '{"type": "string", "title": ' '"Interface", "description": ' '"Interface name"}, "op_status": ' '{"type": "string", "title": ' '"Operational Status", ' '"description": "Operational ' 'status of the interface"}, ' '"admin_status": {"type": ' '"string", "title": "Admin ' 'Status", "description": "Admin ' 'status of the interface"}, ' '"input_rate": {"type": "string", ' '"title": "InputRate (bps)", ' '"description": "Input packets ' 'rate in bits per second if ' 'present"}, "output_rate": ' '{"type": "string", "title": ' '"OutputRate (bps)", ' '"description": "Output packets ' 'rate in bits per second if ' 'present"}}}}}}, {"properties": ' '{"interface_stats_log": {"type": ' '"array", "title": "Logical ' 'Interfaces Statistics", ' '"description": "Display ' 'statistics and detailed output", ' '"items": {"type": "object", ' '"additionalProperties": false, ' '"properties": {"name": {"type": ' '"string", "title": "Interface", ' '"description": "Interface name"}, ' '"address_family": {"type": ' '"string", "title": "Address ' 'Family", "description": "Address ' 'family if present"}}}}}}, ' '{"properties": ' '{"interface_stats_cf_phy": ' '{"type": "array", "title": ' '"Configured Physical Interfaces ' 'Statistics", "description": ' '"Display statistics and detailed ' 'output", "items": {"type": ' '"object", "additionalProperties": ' 'false, "properties": {"name": ' '{"type": "string", "title": ' '"Interface", "description": ' '"Interface name"}}}}}}]}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bfd61d3b-276f-4207-a333-cf481500088d'}, 'oper': 'CREATE', 'request-id': 'req-842c0760-3495-428c-8fbb-54ffeefd4dd4', 'type': 'job_template', 'uuid': 'bfd61d3b-276f-4207-a333-cf481500088d'} 06/02/2025 02:07:47.063 7fad88a75cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'] not found in DB: Unknown id: access_control_list default-domain:default-project:__no_rule__:ingress-access-control-list 06/02/2025 02:07:47.076 7fad88a75cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:ingress-access-control-list url = https://10.0.0.129:8082/access-control-lists operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"access-control-list": {"uuid": null, "fq_name": ["default-domain", "default-project", "__no_rule__", "ingress-access-control-list"], "parent_type": "security-group", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ingress-access-control-list"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:47.113 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'show_config_template'] not found in DB: Unknown id: job_template default-global-system-config:show_config_template 06/02/2025 02:07:47.122 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'id_perms': {'created': '2025-06-02T02:07:47.089962', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:47.089962', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10000768091654880591, 'uuid_mslong': 14396623464916535935}}, 'parent_type': 'security-group', 'parent_uuid': '838ea970-1ee4-4211-9156-eeed8f45976c', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c7cb14c3-c767-4a7f-8ac9-dd97d0267d4f'}, 'oper': 'CREATE', 'request-id': 'req-c7bdd2c0-3168-4a21-be99-e30235b21955', 'type': 'access_control_list', 'uuid': 'c7cb14c3-c767-4a7f-8ac9-dd97d0267d4f'} 06/02/2025 02:07:47.137 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_config_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_config_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"config_type\": {\"$id\": \"/properties/config_type\", \"title\": \"Configuration type\", \"type\": \"string\", \"enum\": [\"current\", \"rollback 1\", \"rollback 2\"], \"default\": \"current\"}, \"config_filter\": {\"$id\": \"/properties/config_filter\", \"title\": \"Configuration filter\", \"type\": \"string\", \"enum\": [\"all\", \"system\", \"system/login\", \"system/services\", \"system/syslog\", \"interfaces\", \"chassis\", \"services\", \"snmp\", \"forwarding-options\", \"event-options\", \"policy-options\", \"class-of-service\", \"firewall\", \"protocols\", \"routing-instances\", \"routing-options\", \"switch-options\", \"vlans\"], \"default\": \"all\"}, \"compare_configurations\": {\"$id\": \"/properties/compare_configurations\", \"title\": \"Compare selected configuration with current\", \"type\": \"boolean\", \"default\": false}}, \"required\": [\"config_type\", \"config_filter\", \"compare_configurations\"]}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show configuration Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Device Configuration\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "{\"config_type\": {\"ui:help\": \"Select one type at a time\"}}", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to display current or previous configuration", "display_name": " Show current or rollback configuration", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:47.226 7fad88a75cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'] not found in DB: Unknown id: access_control_list default-domain:default-project:__no_rule__:egress-access-control-list 06/02/2025 02:07:47.237 7fad88a75cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:egress-access-control-list url = https://10.0.0.129:8082/access-control-lists operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"access-control-list": {"uuid": null, "fq_name": ["default-domain", "default-project", "__no_rule__", "egress-access-control-list"], "parent_type": "security-group", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "egress-access-control-list"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:47.240 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'show_config_template'], 'obj_dict': {'display_name': ' Show current or rollback configuration', 'fq_name': ['default-global-system-config', 'show_config_template'], 'id_perms': {'created': '2025-06-02T02:07:47.176735', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:47.176735', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12006131841447467572, 'uuid_mslong': 11586473952196905870}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display ' 'current or previous configuration', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"config_type": ' '{"$id": "/properties/config_type", ' '"title": "Configuration type", ' '"type": "string", "enum": ' '["current", "rollback 1", ' '"rollback 2"], "default": ' '"current"}, "config_filter": ' '{"$id": ' '"/properties/config_filter", ' '"title": "Configuration filter", ' '"type": "string", "enum": ["all", ' '"system", "system/login", ' '"system/services", ' '"system/syslog", "interfaces", ' '"chassis", "services", "snmp", ' '"forwarding-options", ' '"event-options", "policy-options", ' '"class-of-service", "firewall", ' '"protocols", "routing-instances", ' '"routing-options", ' '"switch-options", "vlans"], ' '"default": "all"}, ' '"compare_configurations": {"$id": ' '"/properties/compare_configurations", ' '"title": "Compare selected ' 'configuration with current", ' '"type": "boolean", "default": ' 'false}}, "required": ' '["config_type", "config_filter", ' '"compare_configurations"]}', 'job_template_input_ui_schema': '{"config_type": {"ui:help": ' '"Select one type at a time"}}', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show configuration ' 'Output", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "Device ' 'Configuration", "description": ' '"Display Device Configuration ' 'output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a0cb6cab-f803-4b8e-a69e-594c6ffb9a34'}, 'oper': 'CREATE', 'request-id': 'req-e6518f87-abd7-4f12-a22f-8293df10fa9f', 'type': 'job_template', 'uuid': 'a0cb6cab-f803-4b8e-a69e-594c6ffb9a34'} 06/02/2025 02:07:47.293 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'id_perms': {'created': '2025-06-02T02:07:47.255491', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:47.255491', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10336754243976511729, 'uuid_mslong': 9605085701581587216}}, 'parent_type': 'security-group', 'parent_uuid': '838ea970-1ee4-4211-9156-eeed8f45976c', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '854c1e8e-3ff4-4310-8f73-8737eabb40f1'}, 'oper': 'CREATE', 'request-id': 'req-549b7c1b-f410-4c87-863b-8aa61f39f110', 'type': 'access_control_list', 'uuid': '854c1e8e-3ff4-4310-8f73-8737eabb40f1'} 06/02/2025 02:07:47.336 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'test_overlay_connectivity_template'] not found in DB: Unknown id: job_template default-global-system-config:test_overlay_connectivity_template 06/02/2025 02:07:47.348 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:test_overlay_connectivity_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "test_overlay_connectivity_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"source_ip\": {\"$id\": \"/properties/source_ip\", \"title\": \"Source (device loopback IP)\", \"type\": \"string\", \"default\": \"\"}, \"destination_ip\": {\"$id\": \"/properties/destination_ip\", \"title\": \"Destination (device loopback IP)\", \"type\": \"string\", \"default\": \"\"}, \"vni\": {\"$id\": \"/properties/vni\", \"title\": \"VNI\", \"type\": \"integer\", \"default\": 100}, \"count\": {\"$id\": \"/properties/count\", \"title\": \"Packet count\", \"type\": \"integer\", \"default\": 5}}, \"required\": [\"source_ip\", \"destination_ip\", \"count\", \"vni\"]}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show connectivity test report\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Each playbook's command_output for this specific command.\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Connectivity test report\", \"description\": \"Display connectivity test report\"}}}}}}}}", "job_template_input_ui_schema": "{\"destination_ip\": {\"ui:help\": \"\"}}", "job_template_output_ui_schema": "null", "job_template_description": "", "display_name": "Test overlay connectivity", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:47.406 7fad88a75cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['target:64512:8000000'] not found in DB: Unknown id: route_target target:64512:8000000 06/02/2025 02:07:47.407 7fad88a75cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000000 url = https://10.0.0.129:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000000"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000000"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:47.442 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['target:64512:8000000'], 'obj_dict': {'display_name': 'target:64512:8000000', 'fq_name': ['target:64512:8000000'], 'id_perms': {'created': '2025-06-02T02:07:47.433397', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:47.433397', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10394576711460615824, 'uuid_mslong': 6183597623143711246}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '55d08d46-b16e-420e-9040-f4723d287690'}, 'oper': 'CREATE', 'request-id': 'req-b4b6ba3d-887a-4f0c-91df-c3dc439764c3', 'type': 'route_target', 'uuid': '55d08d46-b16e-420e-9040-f4723d287690'} 06/02/2025 02:07:47.454 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'test_overlay_connectivity_template'], 'obj_dict': {'display_name': 'Test overlay connectivity', 'fq_name': ['default-global-system-config', 'test_overlay_connectivity_template'], 'id_perms': {'created': '2025-06-02T02:07:47.381835', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:47.381835', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11098267344920246776, 'uuid_mslong': 11872916786312201502}}, 'job_template_concurrency_level': 'device', 'job_template_description': '', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"source_ip": ' '{"$id": "/properties/source_ip", ' '"title": "Source (device loopback ' 'IP)", "type": "string", "default": ' '""}, "destination_ip": {"$id": ' '"/properties/destination_ip", ' '"title": "Destination (device ' 'loopback IP)", "type": "string", ' '"default": ""}, "vni": {"$id": ' '"/properties/vni", "title": "VNI", ' '"type": "integer", "default": ' '100}, "count": {"$id": ' '"/properties/count", "title": ' '"Packet count", "type": "integer", ' '"default": 5}}, "required": ' '["source_ip", "destination_ip", ' '"count", "vni"]}', 'job_template_input_ui_schema': '{"destination_ip": {"ui:help": ' '""}}', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show connectivity test ' 'report", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Each playbook\'s ' 'command_output for this specific ' 'command.", "properties": ' '{"config_output": {"type": ' '"string", "title": "Connectivity ' 'test report", "description": ' '"Display connectivity test ' 'report"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a4c512e9-67e9-451e-9a04-f7595c49f9f8'}, 'oper': 'CREATE', 'request-id': 'req-380fde5f-239d-4885-a1bd-de91ef45d60e', 'type': 'job_template', 'uuid': 'a4c512e9-67e9-451e-9a04-f7595c49f9f8'} 06/02/2025 02:07:47.469 7fad88a75cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b797f728-3795-4d3b-8b8f-c4c251d19617 object_type = routing_instance identifier_name = default-domain:default-project:dci-network:__default__ url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"type": "routing-instance", "uuid": "b797f728-3795-4d3b-8b8f-c4c251d19617", "ref-type": "route-target", "ref-uuid": "55d08d46-b16e-420e-9040-f4723d287690", "ref-fq-name": ["target:64512:8000000"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:47.495 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'oper': 'UPDATE', 'request-id': 'req-70905841-2f32-41e5-9555-fea7eeeb220f', 'type': 'routing_instance', 'uuid': 'b797f728-3795-4d3b-8b8f-c4c251d19617'} 06/02/2025 02:07:47.548 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'show_ops_info_template'] not found in DB: Unknown id: job_template default-global-system-config:show_ops_info_template 06/02/2025 02:07:47.570 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_ops_info_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_ops_info_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ops_type\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"Operations commands\", \"type\": \"array\", \"minItems\": 1, \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"minProperties\": 1, \"additionalProperties\": false, \"properties\": {\"conditional\": {\"title\": \"Operation Command Type\", \"$ref\": \"#/definitions/sub_command\"}}}}}, \"definitions\": {\"sub_command\": {\"type\": \"object\", \"properties\": {\"sub_operation\": {\"title\": \"Choose a sub-operation\", \"type\": \"string\", \"enum\": [\"show chassis info\", \"show route info\", \"show bgp info\", \"show evpn info\", \"show lldp info\", \"show lacp info\", \"show vlan info\"], \"default\": \"show route info\"}}, \"required\": [\"sub_operation\"], \"dependencies\": {\"sub_operation\": {\"oneOf\": [{\"properties\": {\"sub_operation\": {\"enum\": [\"show chassis info\"]}, \"command_detail\": {\"$id\": \"/properties/chassis_detail\", \"title\": \"Chassis detail\", \"type\": \"string\", \"enum\": [\"chassis alarms\", \"chassis environment\", \"chassis environment cb\", \"chassis environment fpc\", \"chassis environment pem\", \"chassis environment routing-engine\", \"chassis fpc detail\", \"chassis fan\", \"chassis firmware\", \"chassis mac-addresses\", \"chassis routing-engine\", \"chassis power\", \"chassis hardware\", \"chassis hardware detail\", \"chassis hardware clei-models\", \"chassis temperature-thresholds\"], \"default\": \"chassis alarms\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show route info\"]}, \"command_detail\": {\"$id\": \"/properties/route_detail\", \"title\": \"Route detail\", \"type\": \"string\", \"enum\": [\"route summary\"], \"default\": \"route summary\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show bgp info\"]}, \"command_detail\": {\"$id\": \"/properties/bgp_detail\", \"title\": \"BGP detail\", \"type\": \"string\", \"enum\": [\"bgp summary\", \"bgp neighbor\", \"bgp group\"], \"default\": \"bgp summary\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show evpn info\"]}, \"command_detail\": {\"$id\": \"/properties/evpn_detail\", \"title\": \"EVPN detail\", \"type\": \"string\", \"enum\": [\"evpn ip-prefix-database\", \"evpn instance extensive\", \"evpn instance designated-forwarder\", \"evpn instance backup-forwarder\", \"evpn database state default-gateway\"], \"default\": \"evpn ip-prefix-database\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show lldp info\"]}, \"command_detail\": {\"$id\": \"/properties/lldp_detail\", \"title\": \"LLDP detail\", \"type\": \"string\", \"enum\": [\"lldp neighbors\"], \"default\": \"lldp neighbors\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show lacp info\"]}, \"command_detail\": {\"$id\": \"/properties/lacp_detail\", \"title\": \"LACP detail\", \"type\": \"string\", \"enum\": [\"lacp interfaces extensive\", \"lacp statistics interfaces\"], \"default\": \"lacp interfaces extensive\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show vlan info\"]}, \"command_detail\": {\"$id\": \"/properties/vlan_detail\", \"title\": \"VLAN detail\", \"type\": \"string\", \"enum\": [\"vlans\"], \"default\": \"vlans\"}}}]}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show chassis Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Chassis info\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to display operational information", "display_name": "Show operations information", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:47.578 7fad88a75cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['target:64512:8000001'] not found in DB: Unknown id: route_target target:64512:8000001 06/02/2025 02:07:47.579 7fad88a75cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000001 url = https://10.0.0.129:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000001"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000001"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:47.598 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['target:64512:8000001'], 'obj_dict': {'display_name': 'target:64512:8000001', 'fq_name': ['target:64512:8000001'], 'id_perms': {'created': '2025-06-02T02:07:47.586081', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:47.586081', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12531916260735465956, 'uuid_mslong': 1652154133657963462}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '16eda16e-5ae0-4bc6-adea-4f71341439e4'}, 'oper': 'CREATE', 'request-id': 'req-bb6347c0-f720-4171-9d4f-0bf7ead12f4f', 'type': 'route_target', 'uuid': '16eda16e-5ae0-4bc6-adea-4f71341439e4'} 06/02/2025 02:07:47.654 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'show_ops_info_template'], 'obj_dict': {'display_name': 'Show operations information', 'fq_name': ['default-global-system-config', 'show_ops_info_template'], 'id_perms': {'created': '2025-06-02T02:07:47.597478', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:47.597478', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10967056590007161909, 'uuid_mslong': 1456611575749234360}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display ' 'operational information', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"ops_type": {"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "Operations commands", ' '"type": "array", "minItems": 1, ' '"items": {"$id": ' '"/properties/interface_filters/items", ' '"type": "object", "minProperties": ' '1, "additionalProperties": false, ' '"properties": {"conditional": ' '{"title": "Operation Command ' 'Type", "$ref": ' '"#/definitions/sub_command"}}}}}, ' '"definitions": {"sub_command": ' '{"type": "object", "properties": ' '{"sub_operation": {"title": ' '"Choose a sub-operation", "type": ' '"string", "enum": ["show chassis ' 'info", "show route info", "show ' 'bgp info", "show evpn info", "show ' 'lldp info", "show lacp info", ' '"show vlan info"], "default": ' '"show route info"}}, "required": ' '["sub_operation"], "dependencies": ' '{"sub_operation": {"oneOf": ' '[{"properties": {"sub_operation": ' '{"enum": ["show chassis info"]}, ' '"command_detail": {"$id": ' '"/properties/chassis_detail", ' '"title": "Chassis detail", "type": ' '"string", "enum": ["chassis ' 'alarms", "chassis environment", ' '"chassis environment cb", "chassis ' 'environment fpc", "chassis ' 'environment pem", "chassis ' 'environment routing-engine", ' '"chassis fpc detail", "chassis ' 'fan", "chassis firmware", "chassis ' 'mac-addresses", "chassis ' 'routing-engine", "chassis power", ' '"chassis hardware", "chassis ' 'hardware detail", "chassis ' 'hardware clei-models", "chassis ' 'temperature-thresholds"], ' '"default": "chassis alarms"}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["show route info"]}, ' '"command_detail": {"$id": ' '"/properties/route_detail", ' '"title": "Route detail", "type": ' '"string", "enum": ["route ' 'summary"], "default": "route ' 'summary"}}}, {"properties": ' '{"sub_operation": {"enum": ["show ' 'bgp info"]}, "command_detail": ' '{"$id": "/properties/bgp_detail", ' '"title": "BGP detail", "type": ' '"string", "enum": ["bgp summary", ' '"bgp neighbor", "bgp group"], ' '"default": "bgp summary"}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["show evpn info"]}, ' '"command_detail": {"$id": ' '"/properties/evpn_detail", ' '"title": "EVPN detail", "type": ' '"string", "enum": ["evpn ' 'ip-prefix-database", "evpn ' 'instance extensive", "evpn ' 'instance designated-forwarder", ' '"evpn instance backup-forwarder", ' '"evpn database state ' 'default-gateway"], "default": ' '"evpn ip-prefix-database"}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["show lldp info"]}, ' '"command_detail": {"$id": ' '"/properties/lldp_detail", ' '"title": "LLDP detail", "type": ' '"string", "enum": ["lldp ' 'neighbors"], "default": "lldp ' 'neighbors"}}}, {"properties": ' '{"sub_operation": {"enum": ["show ' 'lacp info"]}, "command_detail": ' '{"$id": "/properties/lacp_detail", ' '"title": "LACP detail", "type": ' '"string", "enum": ["lacp ' 'interfaces extensive", "lacp ' 'statistics interfaces"], ' '"default": "lacp interfaces ' 'extensive"}}}, {"properties": ' '{"sub_operation": {"enum": ["show ' 'vlan info"]}, "command_detail": ' '{"$id": "/properties/vlan_detail", ' '"title": "VLAN detail", "type": ' '"string", "enum": ["vlans"], ' '"default": "vlans"}}}]}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show chassis Output", ' '"type": "object", "properties": ' '{"results": {"type": "array", ' '"description": "Array holding the ' 'specific output details in case ' 'of success. Each object of the ' 'array would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "Chassis ' 'info", "description": "Display ' 'Device Configuration ' 'output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1436ec82-bc41-4eb8-9832-cfdcd6fbd435'}, 'oper': 'CREATE', 'request-id': 'req-e438d56d-ba45-4b33-a272-721c3075c476', 'type': 'job_template', 'uuid': '1436ec82-bc41-4eb8-9832-cfdcd6fbd435'} 06/02/2025 02:07:47.659 7fad88a75cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 24543193-7b9b-485c-a256-cea4c5a59075 object_type = routing_instance identifier_name = default-domain:default-project:dci-network:dci-network url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"type": "routing-instance", "uuid": "24543193-7b9b-485c-a256-cea4c5a59075", "ref-type": "route-target", "ref-uuid": "16eda16e-5ae0-4bc6-adea-4f71341439e4", "ref-fq-name": ["target:64512:8000001"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:47.682 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'oper': 'UPDATE', 'request-id': 'req-b3c09f6e-687c-45d6-a253-b7db4ff97a21', 'type': 'routing_instance', 'uuid': '24543193-7b9b-485c-a256-cea4c5a59075'} 06/02/2025 02:07:47.748 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'check_multicast_template'] not found in DB: Unknown id: job_template default-global-system-config:check_multicast_template 06/02/2025 02:07:47.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:47.764 7fad88a75cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['target:64512:8000002'] not found in DB: Unknown id: route_target target:64512:8000002 06/02/2025 02:07:47.766 7fad88a75cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000002 url = https://10.0.0.129:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000002"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000002"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:47.769 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:check_multicast_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "check_multicast_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"warning_banner\": {\"$id\": \"/properties/warning_banner\", \"title\": \"This GDO gathers multicast statistics from the whole fabric and it might take a few minutes to complete.\", \"type\": \"object\", \"properties\": {\"warning_banner_2\": {\"$id\": \"/properties/warning_banner_2\", \"title\": \"It is assumed that:\", \"type\": \"object\", \"properties\": {\"warning_banner_3\": {\"$id\": \"/properties/warning_banner_3\", \"title\": \"(1) the traffic is coming from outside of the fabric (through device(s) with CRB-MCAST-Gateway role);\", \"type\": \"object\", \"properties\": {\"warning_banner_4\": {\"$id\": \"/properties/warning_banner_4\", \"title\": \"(2) the traffic is going to devices attached to server leaves (physical_router_role == 'leaf');\", \"type\": \"object\", \"properties\": {\"warning_banner_5\": {\"$id\": \"/properties/warning_banner_5\", \"title\": \"(3) PIM is enabled in the fabric.\", \"type\": \"object\", \"properties\": {}}}}}}}}}}, \"source\": {\"$id\": \"/properties/source\", \"title\": \"Source\", \"type\": \"string\", \"default\": \"\"}, \"group\": {\"$id\": \"/properties/group\", \"title\": \"Group\", \"type\": \"string\", \"default\": \"\"}}, \"required\": [\"source\", \"group\"]}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Check multicast output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Device Configuration\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "Check multicast", "display_name": "Check incoming multicast traffic", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:47.789 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['target:64512:8000002'], 'obj_dict': {'display_name': 'target:64512:8000002', 'fq_name': ['target:64512:8000002'], 'id_perms': {'created': '2025-06-02T02:07:47.774173', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:47.774173', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10805429065655984574, 'uuid_mslong': 12063785012381698579}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'a76b2c8d-55b1-4a13-95f4-987c501b21be'}, 'oper': 'CREATE', 'request-id': 'req-b0a7433c-08ca-415d-96b6-bd9ad6391e73', 'type': 'route_target', 'uuid': 'a76b2c8d-55b1-4a13-95f4-987c501b21be'} 06/02/2025 02:07:47.847 7fad88a75cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 42148f17-2c60-42d0-b63a-897fcd809d4a object_type = routing_instance identifier_name = default-domain:default-project:default-virtual-network:default-virtual-network url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"type": "routing-instance", "uuid": "42148f17-2c60-42d0-b63a-897fcd809d4a", "ref-type": "route-target", "ref-uuid": "a76b2c8d-55b1-4a13-95f4-987c501b21be", "ref-fq-name": ["target:64512:8000002"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:47.866 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'oper': 'UPDATE', 'request-id': 'req-78f2ce3f-1870-447c-9025-c971e6e08981', 'type': 'routing_instance', 'uuid': '42148f17-2c60-42d0-b63a-897fcd809d4a'} 06/02/2025 02:07:47.888 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'check_multicast_template'], 'obj_dict': {'display_name': 'Check incoming multicast traffic', 'fq_name': ['default-global-system-config', 'check_multicast_template'], 'id_perms': {'created': '2025-06-02T02:07:47.794913', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:47.794913', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13408130221123712375, 'uuid_mslong': 9304628920680269915}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'Check multicast', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"warning_banner": ' '{"$id": ' '"/properties/warning_banner", ' '"title": "This GDO gathers ' 'multicast statistics from the ' 'whole fabric and it might take a ' 'few minutes to complete.", "type": ' '"object", "properties": ' '{"warning_banner_2": {"$id": ' '"/properties/warning_banner_2", ' '"title": "It is assumed that:", ' '"type": "object", "properties": ' '{"warning_banner_3": {"$id": ' '"/properties/warning_banner_3", ' '"title": "(1) the traffic is ' 'coming from outside of the fabric ' '(through device(s) with ' 'CRB-MCAST-Gateway role);", "type": ' '"object", "properties": ' '{"warning_banner_4": {"$id": ' '"/properties/warning_banner_4", ' '"title": "(2) the traffic is going ' 'to devices attached to server ' 'leaves (physical_router_role == ' '\'leaf\');", "type": "object", ' '"properties": {"warning_banner_5": ' '{"$id": ' '"/properties/warning_banner_5", ' '"title": "(3) PIM is enabled in ' 'the fabric.", "type": "object", ' '"properties": {}}}}}}}}}}, ' '"source": {"$id": ' '"/properties/source", "title": ' '"Source", "type": "string", ' '"default": ""}, "group": {"$id": ' '"/properties/group", "title": ' '"Group", "type": "string", ' '"default": ""}}, "required": ' '["source", "group"]}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Check multicast ' 'output", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "Device ' 'Configuration", "description": ' '"Display Device Configuration ' 'output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8120aeb4-8ff9-485b-ba13-3f6594423577'}, 'oper': 'CREATE', 'request-id': 'req-5cef0053-c949-43f4-be90-bce5e5d75ba9', 'type': 'job_template', 'uuid': '8120aeb4-8ff9-485b-ba13-3f6594423577'} 06/02/2025 02:07:47.927 7fad88a75cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['target:64512:8000003'] not found in DB: Unknown id: route_target target:64512:8000003 06/02/2025 02:07:47.928 7fad88a75cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000003 url = https://10.0.0.129:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000003"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000003"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:47.972 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['target:64512:8000003'], 'obj_dict': {'display_name': 'target:64512:8000003', 'fq_name': ['target:64512:8000003'], 'id_perms': {'created': '2025-06-02T02:07:47.943781', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:47.943781', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13429171572953463951, 'uuid_mslong': 11324343719304643168}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '9d28269d-1f94-4260-ba5e-006511aa3c8f'}, 'oper': 'CREATE', 'request-id': 'req-2e3a53a6-7657-4232-bb78-f9f2be10c5ce', 'type': 'route_target', 'uuid': '9d28269d-1f94-4260-ba5e-006511aa3c8f'} 06/02/2025 02:07:47.986 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'existing_fabric_onboard_template'] not found in DB: Unknown id: job_template default-global-system-config:existing_fabric_onboard_template 06/02/2025 02:07:47.994 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:existing_fabric_onboard_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "existing_fabric_onboard_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/existing_fabric_onboard.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_device.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 20, "sequence_no": 1}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_role.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 2}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 5, "sequence_no": 3}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/device_import.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 40, "sequence_no": 4}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/topology_discovery.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 5}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\", \"management_subnets\", \"device_auth\", \"node_profiles\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"fabric_display_name\": {\"type\": \"string\"}, \"fabric_cluster_id\": {\"type\": \"integer\"}, \"management_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"description\": \"List of the management network subnets for the fabric\", \"additionalProperties\": false, \"required\": [\"cidr\"], \"properties\": {\"cidr\": {\"type\": \"string\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}, \"gateway\": {\"type\": \"string\", \"format\": \"ipv4\"}}}}, \"loopback_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that fabric device loopback ips can be allocated.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"overlay_loopback_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that fabric device overlay loopback ips can be allocated.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"fabric_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that could be carved out for the p2p networks between fabric devices.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"pnf_servicechain_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that could be carved out for service chaining between fabric devices.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"fabric_asn_pool\": {\"type\": \"array\", \"items\": {\"title\": \"eBGP ASN Pool for fabric underlay network\", \"type\": \"object\", \"description\": \"List of the ASN pools that could be used to configure the eBGP peers for the IP fabric\", \"properties\": {\"asn_min\": {\"type\": \"integer\"}, \"asn_max\": {\"type\": \"integer\"}}, \"required\": [\"asn_min\", \"asn_max\"]}}, \"overlay_ibgp_asn\": {\"type\": \"integer\", \"title\": \"iBGP ASN for Contrail overlay network\", \"default\": 64512}, \"device_auth\": {\"title\": \"Device Auth\", \"type\": \"array\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"required\": [\"username\", \"password\"], \"properties\": {\"username\": {\"type\": \"string\"}, \"password\": {\"type\": \"string\"}}}}, \"node_profiles\": {\"type\": \"array\", \"items\": {\"title\": \"Node profile\", \"type\": \"object\", \"description\": \"List of node profiles to be used by the fabric.\", \"additionalProperties\": false, \"properties\": {\"node_profile_name\": {\"type\": \"string\"}, \"serial_nums\": {\"type\": \"array\", \"description\": \"Optional list of serial numbers of fabric devices that we want to associate with this node profile.\", \"items\": {\"type\": \"string\"}}}, \"required\": [\"node_profile_name\"]}}, \"interface_filters\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"]}, \"expr\": {\"type\": \"string\"}}, \"title\": \"filter object\", \"description\": \"filter object having op and expr fields\", \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}, \"manage_underlay\": {\"title\": \"Manage underlay networking\", \"type\": \"boolean\", \"description\": \"Set to true if need to configure underlay networking\", \"default\": false}, \"import_configured\": {\"type\": \"boolean\", \"default\": false, \"description\": \"Not importing configured interfaces by default. Set this option to true if configured interfaces need to be imported as part of onboarding.\"}, \"device_count\": {\"title\": \"Number of fabric devices\", \"type\": \"integer\", \"description\": \"Total number of devices in the fabric that needs to be zero-touch provisioned\"}, \"enterprise_style\": {\"type\": \"boolean\", \"default\": true, \"description\": \"True if enterprise style, false if sp-style configuration\"}, \"disable_vlan_vn_uniqueness_check\": {\"type\": \"boolean\", \"default\": false, \"description\": \"True if vlan-vn uniqueness validation checks needs to be disabled, false if enable all complex validations\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Existing Fabric Onboarding", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.065 7fad88a75cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4439bfb8-6651-482b-a1c3-f5e57eb0f0f9 object_type = routing_instance identifier_name = default-domain:default-project:ip-fabric:ip-fabric url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"type": "routing-instance", "uuid": "4439bfb8-6651-482b-a1c3-f5e57eb0f0f9", "ref-type": "route-target", "ref-uuid": "9d28269d-1f94-4260-ba5e-006511aa3c8f", "ref-fq-name": ["target:64512:8000003"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.077 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'existing_fabric_onboard_template'], 'obj_dict': {'display_name': 'Existing Fabric Onboarding', 'fq_name': ['default-global-system-config', 'existing_fabric_onboard_template'], 'id_perms': {'created': '2025-06-02T02:07:48.013777', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:48.013777', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11595110069029593903, 'uuid_mslong': 9143463801449958280}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name", ' '"management_subnets", ' '"device_auth", "node_profiles"], ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"fabric_display_name": {"type": ' '"string"}, "fabric_cluster_id": ' '{"type": "integer"}, ' '"management_subnets": {"type": ' '"array", "items": {"type": ' '"object", "description": "List of ' 'the management network subnets for ' 'the fabric", ' '"additionalProperties": false, ' '"required": ["cidr"], ' '"properties": {"cidr": {"type": ' '"string", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}, ' '"gateway": {"type": "string", ' '"format": "ipv4"}}}}, ' '"loopback_subnets": {"type": ' '"array", "items": {"type": ' '"string", "description": "List of ' 'the subnet prefixes that fabric ' 'device loopback ips can be ' 'allocated.", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"overlay_loopback_subnets": ' '{"type": "array", "items": ' '{"type": "string", "description": ' '"List of the subnet prefixes that ' 'fabric device overlay loopback ips ' 'can be allocated.", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"fabric_subnets": {"type": ' '"array", "items": {"type": ' '"string", "description": "List of ' 'the subnet prefixes that could be ' 'carved out for the p2p networks ' 'between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"pnf_servicechain_subnets": ' '{"type": "array", "items": ' '{"type": "string", "description": ' '"List of the subnet prefixes that ' 'could be carved out for service ' 'chaining between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"fabric_asn_pool": {"type": ' '"array", "items": {"title": "eBGP ' 'ASN Pool for fabric underlay ' 'network", "type": "object", ' '"description": "List of the ASN ' 'pools that could be used to ' 'configure the eBGP peers for the ' 'IP fabric", "properties": ' '{"asn_min": {"type": "integer"}, ' '"asn_max": {"type": "integer"}}, ' '"required": ["asn_min", ' '"asn_max"]}}, "overlay_ibgp_asn": ' '{"type": "integer", "title": "iBGP ' 'ASN for Contrail overlay network", ' '"default": 64512}, "device_auth": ' '{"title": "Device Auth", "type": ' '"array", "items": {"type": ' '"object", "additionalProperties": ' 'false, "required": ["username", ' '"password"], "properties": ' '{"username": {"type": "string"}, ' '"password": {"type": "string"}}}}, ' '"node_profiles": {"type": "array", ' '"items": {"title": "Node profile", ' '"type": "object", "description": ' '"List of node profiles to be used ' 'by the fabric.", ' '"additionalProperties": false, ' '"properties": ' '{"node_profile_name": {"type": ' '"string"}, "serial_nums": {"type": ' '"array", "description": "Optional ' 'list of serial numbers of fabric ' 'devices that we want to associate ' 'with this node profile.", "items": ' '{"type": "string"}}}, "required": ' '["node_profile_name"]}}, ' '"interface_filters": {"type": ' '"array", "items": {"type": ' '"object", "maxProperties": 2, ' '"additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"]}, "expr": {"type": ' '"string"}}, "title": "filter ' 'object", "description": "filter ' 'object having op and expr fields", ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}, ' '"manage_underlay": {"title": ' '"Manage underlay networking", ' '"type": "boolean", "description": ' '"Set to true if need to configure ' 'underlay networking", "default": ' 'false}, "import_configured": ' '{"type": "boolean", "default": ' 'false, "description": "Not ' 'importing configured interfaces by ' 'default. Set this option to true ' 'if configured interfaces need to ' 'be imported as part of ' 'onboarding."}, "device_count": ' '{"title": "Number of fabric ' 'devices", "type": "integer", ' '"description": "Total number of ' 'devices in the fabric that needs ' 'to be zero-touch provisioned"}, ' '"enterprise_style": {"type": ' '"boolean", "default": true, ' '"description": "True if enterprise ' 'style, false if sp-style ' 'configuration"}, ' '"disable_vlan_vn_uniqueness_check": ' '{"type": "boolean", "default": ' 'false, "description": "True if ' 'vlan-vn uniqueness validation ' 'checks needs to be disabled, false ' 'if enable all complex ' 'validations"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/existing_fabric_onboard.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 20, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_device.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_role.yml', 'refresh_token': False, 'sequence_no': 2, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml', 'refresh_token': False, 'sequence_no': 3, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 40, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/device_import.yml', 'refresh_token': False, 'sequence_no': 4, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/topology_discovery.yml', 'refresh_token': False, 'sequence_no': 5, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7ee41be2-1e11-4b88-a0ea-1b2c9c10632f'}, 'oper': 'CREATE', 'request-id': 'req-0f87df0c-fd7f-43f6-94a5-faa089f31c4d', 'type': 'job_template', 'uuid': '7ee41be2-1e11-4b88-a0ea-1b2c9c10632f'} 06/02/2025 02:07:48.089 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-87880213-5392-403e-884c-1de85878ed80', 'type': 'routing_instance', 'uuid': '4439bfb8-6651-482b-a1c3-f5e57eb0f0f9'} 06/02/2025 02:07:48.169 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'vcenter_import_template'] not found in DB: Unknown id: job_template default-global-system-config:vcenter_import_template 06/02/2025 02:07:48.174 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:vcenter_import_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "vcenter_import_template"], "parent_type": "global-system-config", "job_template_type": "executable", "job_template_concurrency_level": "fabric", "job_template_executables": {"executable_info": [{"executable_path": "/opt/contrail/utils/vcenter-import", "executable_args": "", "job_completion_weightage": 100}]}, "job_template_input_schema": "{\"title\": \"vCenter Import\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"contrail_command\": {\"$id\": \"/properties/contrail_command\", \"description\": \"The Contrail Command details\", \"type\": \"object\", \"properties\": {\"username\": {\"$id\": \"/properties/contrail_command/username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"password\": {\"$id\": \"/properties/contrail_command/password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"host\": {\"$id\": \"/properties/contrail_command/host\", \"description\": \"The Contrail Command IP and/or port\", \"type\": \"string\"}}}, \"vcenter\": {\"$id\": \"/properties/vcenter\", \"description\": \"vCenter details\", \"type\": \"object\", \"properties\": {\"username\": {\"$id\": \"/properties/vcenter/username\", \"description\": \"Username of vCenter Server\", \"type\": \"string\"}, \"password\": {\"$id\": \"/properties/vcenter/password\", \"description\": \"Password of vCenter Server\", \"type\": \"string\"}, \"datacenter\": {\"$id\": \"/properties/vcenter/datacenter\", \"description\": \"vCenter DataCenter name to Import ESXi Hosts\", \"type\": \"string\"}, \"host\": {\"$id\": \"/properties/vcenter/host\", \"description\": \"vCenter Hostname/IP-Address including port\", \"type\": \"string\"}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "VCenter Import", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.198 7fad88a75cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'] not found in DB: Unknown id: access_control_list default-domain:default-project:ip-fabric:ip-fabric 06/02/2025 02:07:48.211 7fad88a75cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = access_control_list identifier_name = default-domain:default-project:ip-fabric:ip-fabric url = https://10.0.0.129:8082/access-control-lists operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"access-control-list": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "ip-fabric"], "parent_type": "virtual-network", "access_control_list_entries": {"dynamic": false, "acl_rule": [{"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "deny", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000002", "direction": "<>"}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ip-fabric"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.226 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'vcenter_import_template'], 'obj_dict': {'display_name': 'VCenter Import', 'fq_name': ['default-global-system-config', 'vcenter_import_template'], 'id_perms': {'created': '2025-06-02T02:07:48.206064', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:48.206064', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11846207132316020159, 'uuid_mslong': 15297025400342857254}}, 'job_template_concurrency_level': 'fabric', 'job_template_executables': {'executable_info': [{'executable_args': '', 'executable_path': '/opt/contrail/utils/vcenter-import', 'job_completion_weightage': 100}]}, 'job_template_input_schema': '{"title": "vCenter Import", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"contrail_command": {"$id": ' '"/properties/contrail_command", ' '"description": "The Contrail ' 'Command details", "type": ' '"object", "properties": ' '{"username": {"$id": ' '"/properties/contrail_command/username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "password": {"$id": ' '"/properties/contrail_command/password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, "host": {"$id": ' '"/properties/contrail_command/host", ' '"description": "The Contrail ' 'Command IP and/or port", "type": ' '"string"}}}, "vcenter": {"$id": ' '"/properties/vcenter", ' '"description": "vCenter details", ' '"type": "object", "properties": ' '{"username": {"$id": ' '"/properties/vcenter/username", ' '"description": "Username of ' 'vCenter Server", "type": ' '"string"}, "password": {"$id": ' '"/properties/vcenter/password", ' '"description": "Password of ' 'vCenter Server", "type": ' '"string"}, "datacenter": {"$id": ' '"/properties/vcenter/datacenter", ' '"description": "vCenter DataCenter ' 'name to Import ESXi Hosts", ' '"type": "string"}, "host": {"$id": ' '"/properties/vcenter/host", ' '"description": "vCenter ' 'Hostname/IP-Address including ' 'port", "type": "string"}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_type': 'executable', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd449f38d-f390-4626-a466-2e9f79652dbf'}, 'oper': 'CREATE', 'request-id': 'req-ed572e86-e0ac-434e-88e2-dd9b216a3c3d', 'type': 'job_template', 'uuid': 'd449f38d-f390-4626-a466-2e9f79652dbf'} 06/02/2025 02:07:48.255 7fad85826588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:48.302 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'deny'}, 'direction': '<>', 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000002'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}], 'dynamic': False}, 'display_name': 'ip-fabric', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'id_perms': {'created': '2025-06-02T02:07:48.237904', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:48.237904', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9459133932906218082, 'uuid_mslong': 11467052905369387429}}, 'parent_type': 'virtual-network', 'parent_uuid': 'e321a686-481b-40eb-913d-c368c1a2c12e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9f2327dc-c527-41a5-8345-983201b80262'}, 'oper': 'CREATE', 'request-id': 'req-cfe05e65-1acd-4b38-97fe-74ff8c46ee13', 'type': 'access_control_list', 'uuid': '9f2327dc-c527-41a5-8345-983201b80262'} 06/02/2025 02:07:48.322 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'discover_server_template'] not found in DB: Unknown id: job_template default-global-system-config:discover_server_template 06/02/2025 02:07:48.331 7fad855636d8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_server_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_server_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_server.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"server info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"ipmi\": {\"$id\": \"/properties/ipmi\", \"type\": \"object\", \"required\": [\"ipmi_subnet_list\", \"ipmi_credentials\"], \"properties\": {\"ipmi_subnet_list\": {\"$id\": \"/properties/ipmi/properties/ipmi_subnet_list\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/ipmi/properties/ipmi_subnet_list/items\", \"type\": \"string\", \"description\": \"List of the subnet prefixes that could be carved out for the p2p networks between fabric devices.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"ipmi_credentials\": {\"$id\": \"/properties/ipmi/properties/ipmi_credentials\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/ipmi/properties/ipmi_credentials/items\", \"description\": \"The IPMI user:password credentials\", \"type\": \"string\"}}, \"ipmi_port_ranges\": {\"$id\": \"/properties/ipmi/properties/ipmi_port_ranges\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/ipmi/properties/ipmi_credentials/items\", \"type\": \"object\", \"required\": [\"port_range_start\", \"port_range_end\"], \"properties\": {\"port_range_start\": {\"$id\": \"/properties/ipmi/properties/ipmi_port_ranges/items/port_range_start\", \"description\": \"Start of IPMI Port Range\", \"type\": \"integer\"}, \"port_range_end\": {\"$id\": \"/properties/ipmi/properties/ipmi_port_ranges/items/port_range_end\", \"description\": \"End of IPMI Port Range\", \"type\": \"integer\"}}}}}}, \"ironic\": {\"$id\": \"/properties/ironic\", \"type\": \"object\", \"required\": [\"auth_url\", \"username\", \"password\"], \"properties\": {\"auth_url\": {\"$id\": \"/properties/ironic/properties/auth_url\", \"description\": \"The Ironic Auth URL\", \"type\": \"string\"}, \"username\": {\"$id\": \"/properties/ironic/properties/username\", \"description\": \"The Ironic Auth username\", \"type\": \"string\"}, \"password\": {\"$id\": \"/properties/ironic/properties/password\", \"description\": \"The Ironic Auth password\", \"type\": \"string\"}, \"introspection_flag\": {\"$id\": \"/properties/ironic/properties/introspection_flag\", \"description\": \"Flag to determine if introspection is needed\", \"type\": \"boolean\", \"default\": true}}}, \"cc_username\": {\"$id\": \"/properties/cc_username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/cc_password\", \"type\": \"string\"}, \"contrail_command_host\": {\"$id\": \"/properties/contrail_command_host\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Server Discovery", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.331 7fad855636d8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_server_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_server_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_server.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"server info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"ipmi\": {\"$id\": \"/properties/ipmi\", \"type\": \"object\", \"required\": [\"ipmi_subnet_list\", \"ipmi_credentials\"], \"properties\": {\"ipmi_subnet_list\": {\"$id\": \"/properties/ipmi/properties/ipmi_subnet_list\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/ipmi/properties/ipmi_subnet_list/items\", \"type\": \"string\", \"description\": \"List of the subnet prefixes that could be carved out for the p2p networks between fabric devices.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"ipmi_credentials\": {\"$id\": \"/properties/ipmi/properties/ipmi_credentials\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/ipmi/properties/ipmi_credentials/items\", \"description\": \"The IPMI user:password credentials\", \"type\": \"string\"}}, \"ipmi_port_ranges\": {\"$id\": \"/properties/ipmi/properties/ipmi_port_ranges\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/ipmi/properties/ipmi_credentials/items\", \"type\": \"object\", \"required\": [\"port_range_start\", \"port_range_end\"], \"properties\": {\"port_range_start\": {\"$id\": \"/properties/ipmi/properties/ipmi_port_ranges/items/port_range_start\", \"description\": \"Start of IPMI Port Range\", \"type\": \"integer\"}, \"port_range_end\": {\"$id\": \"/properties/ipmi/properties/ipmi_port_ranges/items/port_range_end\", \"description\": \"End of IPMI Port Range\", \"type\": \"integer\"}}}}}}, \"ironic\": {\"$id\": \"/properties/ironic\", \"type\": \"object\", \"required\": [\"auth_url\", \"username\", \"password\"], \"properties\": {\"auth_url\": {\"$id\": \"/properties/ironic/properties/auth_url\", \"description\": \"The Ironic Auth URL\", \"type\": \"string\"}, \"username\": {\"$id\": \"/properties/ironic/properties/username\", \"description\": \"The Ironic Auth username\", \"type\": \"string\"}, \"password\": {\"$id\": \"/properties/ironic/properties/password\", \"description\": \"The Ironic Auth password\", \"type\": \"string\"}, \"introspection_flag\": {\"$id\": \"/properties/ironic/properties/introspection_flag\", \"description\": \"Flag to determine if introspection is needed\", \"type\": \"boolean\", \"default\": true}}}, \"cc_username\": {\"$id\": \"/properties/cc_username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/cc_password\", \"type\": \"string\"}, \"contrail_command_host\": {\"$id\": \"/properties/contrail_command_host\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Server Discovery", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.356 7fad855648d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c7cb14c3-c767-4a7f-8ac9-dd97d0267d4f object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:ingress-access-control-list url = https://10.0.0.129:8082/access-control-list/c7cb14c3-c767-4a7f-8ac9-dd97d0267d4f operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"access-control-list": {"uuid": "c7cb14c3-c767-4a7f-8ac9-dd97d0267d4f", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "access_control_list_hash": -782339169199063927}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.357 7fad855648d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c7cb14c3-c767-4a7f-8ac9-dd97d0267d4f object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:ingress-access-control-list url = https://10.0.0.129:8082/access-control-list/c7cb14c3-c767-4a7f-8ac9-dd97d0267d4f operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"access-control-list": {"uuid": "c7cb14c3-c767-4a7f-8ac9-dd97d0267d4f", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "access_control_list_hash": -782339169199063927}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.381 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'discover_server_template'], 'obj_dict': {'display_name': 'Server Discovery', 'fq_name': ['default-global-system-config', 'discover_server_template'], 'id_perms': {'created': '2025-06-02T02:07:48.368842', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:48.368842', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12550235271500467561, 'uuid_mslong': 11518636239023065968}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "server info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, "ipmi": ' '{"$id": "/properties/ipmi", ' '"type": "object", "required": ' '["ipmi_subnet_list", ' '"ipmi_credentials"], "properties": ' '{"ipmi_subnet_list": {"$id": ' '"/properties/ipmi/properties/ipmi_subnet_list", ' '"type": "array", "items": {"$id": ' '"/properties/ipmi/properties/ipmi_subnet_list/items", ' '"type": "string", "description": ' '"List of the subnet prefixes that ' 'could be carved out for the p2p ' 'networks between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"ipmi_credentials": {"$id": ' '"/properties/ipmi/properties/ipmi_credentials", ' '"type": "array", "items": {"$id": ' '"/properties/ipmi/properties/ipmi_credentials/items", ' '"description": "The IPMI ' 'user:password credentials", ' '"type": "string"}}, ' '"ipmi_port_ranges": {"$id": ' '"/properties/ipmi/properties/ipmi_port_ranges", ' '"type": "array", "items": {"$id": ' '"/properties/ipmi/properties/ipmi_credentials/items", ' '"type": "object", "required": ' '["port_range_start", ' '"port_range_end"], "properties": ' '{"port_range_start": {"$id": ' '"/properties/ipmi/properties/ipmi_port_ranges/items/port_range_start", ' '"description": "Start of IPMI Port ' 'Range", "type": "integer"}, ' '"port_range_end": {"$id": ' '"/properties/ipmi/properties/ipmi_port_ranges/items/port_range_end", ' '"description": "End of IPMI Port ' 'Range", "type": "integer"}}}}}}, ' '"ironic": {"$id": ' '"/properties/ironic", "type": ' '"object", "required": ["auth_url", ' '"username", "password"], ' '"properties": {"auth_url": {"$id": ' '"/properties/ironic/properties/auth_url", ' '"description": "The Ironic Auth ' 'URL", "type": "string"}, ' '"username": {"$id": ' '"/properties/ironic/properties/username", ' '"description": "The Ironic Auth ' 'username", "type": "string"}, ' '"password": {"$id": ' '"/properties/ironic/properties/password", ' '"description": "The Ironic Auth ' 'password", "type": "string"}, ' '"introspection_flag": {"$id": ' '"/properties/ironic/properties/introspection_flag", ' '"description": "Flag to determine ' 'if introspection is needed", ' '"type": "boolean", "default": ' 'true}}}, "cc_username": {"$id": ' '"/properties/cc_username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/cc_password", "type": ' '"string"}, ' '"contrail_command_host": {"$id": ' '"/properties/contrail_command_host", ' '"type": "string"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_server.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9fda6aa1-8be9-4b70-ae2b-647c455d0d69'}, 'oper': 'CREATE', 'request-id': 'req-2d439291-60c4-403b-b1ef-fd853486c485', 'type': 'job_template', 'uuid': '9fda6aa1-8be9-4b70-ae2b-647c455d0d69'} 06/02/2025 02:07:48.386 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-27807096-c4ae-4e17-b291-c1b1d8982636', 'type': 'access_control_list', 'uuid': 'c7cb14c3-c767-4a7f-8ac9-dd97d0267d4f'} 06/02/2025 02:07:48.430 7fad854b3e10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 854c1e8e-3ff4-4310-8f73-8737eabb40f1 object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:egress-access-control-list url = https://10.0.0.129:8082/access-control-list/854c1e8e-3ff4-4310-8f73-8737eabb40f1 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"access-control-list": {"uuid": "854c1e8e-3ff4-4310-8f73-8737eabb40f1", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "access_control_list_hash": -782339169199063927}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.430 7fad854b3e10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 854c1e8e-3ff4-4310-8f73-8737eabb40f1 object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:egress-access-control-list url = https://10.0.0.129:8082/access-control-list/854c1e8e-3ff4-4310-8f73-8737eabb40f1 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"access-control-list": {"uuid": "854c1e8e-3ff4-4310-8f73-8737eabb40f1", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "access_control_list_hash": -782339169199063927}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.446 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-ffa4d78e-9960-487b-b904-6c343ea18f07', 'type': 'access_control_list', 'uuid': '854c1e8e-3ff4-4310-8f73-8737eabb40f1'} 06/02/2025 02:07:48.483 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'server_import_template'] not found in DB: Unknown id: job_template default-global-system-config:server_import_template 06/02/2025 02:07:48.492 7fad856016d8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:server_import_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "server_import_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/server_import.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"server import\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"encoded_file\": {\"$id\": \"/properties/encoded_file\", \"description\": \"The Encoded File to Import\", \"type\": \"string\"}, \"file_format\": {\"$id\": \"/properties/file_format\", \"type\": \"string\", \"description\": \"The format of the encoded input file\", \"enum\": [\"yaml\", \"json\", \"YAML\", \"JSON\"]}, \"cc_username\": {\"$id\": \"/properties/cc_username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/cc_password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"contrail_command_host\": {\"$id\": \"/properties/contrail_command_host\", \"description\": \"The Contrail Command IP\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Server Import", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.492 7fad856016d8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:server_import_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "server_import_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/server_import.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"server import\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"encoded_file\": {\"$id\": \"/properties/encoded_file\", \"description\": \"The Encoded File to Import\", \"type\": \"string\"}, \"file_format\": {\"$id\": \"/properties/file_format\", \"type\": \"string\", \"description\": \"The format of the encoded input file\", \"enum\": [\"yaml\", \"json\", \"YAML\", \"JSON\"]}, \"cc_username\": {\"$id\": \"/properties/cc_username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/cc_password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"contrail_command_host\": {\"$id\": \"/properties/contrail_command_host\", \"description\": \"The Contrail Command IP\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Server Import", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.569 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'server_import_template'], 'obj_dict': {'display_name': 'Server Import', 'fq_name': ['default-global-system-config', 'server_import_template'], 'id_perms': {'created': '2025-06-02T02:07:48.507943', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:48.507943', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10423963048979224000, 'uuid_mslong': 6849361207322101361}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "server import", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"encoded_file": {"$id": ' '"/properties/encoded_file", ' '"description": "The Encoded File ' 'to Import", "type": "string"}, ' '"file_format": {"$id": ' '"/properties/file_format", "type": ' '"string", "description": "The ' 'format of the encoded input file", ' '"enum": ["yaml", "json", "YAML", ' '"JSON"]}, "cc_username": {"$id": ' '"/properties/cc_username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/cc_password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, ' '"contrail_command_host": {"$id": ' '"/properties/contrail_command_host", ' '"description": "The Contrail ' 'Command IP", "type": "string"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/server_import.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5f0dd1ba-84c6-4671-90a9-5b2a1e3455c0'}, 'oper': 'CREATE', 'request-id': 'req-883adebc-6185-4a78-873f-b9c9660f5716', 'type': 'job_template', 'uuid': '5f0dd1ba-84c6-4671-90a9-5b2a1e3455c0'} 06/02/2025 02:07:48.667 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'node_profile_template'] not found in DB: Unknown id: job_template default-global-system-config:node_profile_template 06/02/2025 02:07:48.672 7fad85fa6978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:node_profile_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "node_profile_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/node_profile.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Node Profile Import\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"encoded_file\": {\"$id\": \"/properties/encoded_file\", \"description\": \"The Encoded File to Import\", \"type\": \"string\"}, \"file_format\": {\"$id\": \"/properties/file_format\", \"type\": \"string\", \"description\": \"The format of the encoded input file\", \"enum\": [\"yaml\", \"json\", \"YAML\", \"JSON\"]}, \"cc_username\": {\"$id\": \"/properties/cc_username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/cc_password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"contrail_command_host\": {\"$id\": \"/properties/contrail_command_host\", \"description\": \"The Contrail Command Hostname/IP\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Node Profile", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.672 7fad85fa6978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:node_profile_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "node_profile_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/node_profile.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Node Profile Import\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"encoded_file\": {\"$id\": \"/properties/encoded_file\", \"description\": \"The Encoded File to Import\", \"type\": \"string\"}, \"file_format\": {\"$id\": \"/properties/file_format\", \"type\": \"string\", \"description\": \"The format of the encoded input file\", \"enum\": [\"yaml\", \"json\", \"YAML\", \"JSON\"]}, \"cc_username\": {\"$id\": \"/properties/cc_username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/cc_password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"contrail_command_host\": {\"$id\": \"/properties/contrail_command_host\", \"description\": \"The Contrail Command Hostname/IP\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Node Profile", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.742 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'node_profile_template'], 'obj_dict': {'display_name': 'Node Profile', 'fq_name': ['default-global-system-config', 'node_profile_template'], 'id_perms': {'created': '2025-06-02T02:07:48.691356', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:48.691356', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9466145781063333608, 'uuid_mslong': 7337361083019317080}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "Node Profile Import", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"encoded_file": {"$id": ' '"/properties/encoded_file", ' '"description": "The Encoded File ' 'to Import", "type": "string"}, ' '"file_format": {"$id": ' '"/properties/file_format", "type": ' '"string", "description": "The ' 'format of the encoded input file", ' '"enum": ["yaml", "json", "YAML", ' '"JSON"]}, "cc_username": {"$id": ' '"/properties/cc_username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/cc_password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, ' '"contrail_command_host": {"$id": ' '"/properties/contrail_command_host", ' '"description": "The Contrail ' 'Command Hostname/IP", "type": ' '"string"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/node_profile.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '65d38b07-ae24-4f58-835e-816f2057b6e8'}, 'oper': 'CREATE', 'request-id': 'req-69324146-e919-41cf-9026-461d2e02cdb4', 'type': 'job_template', 'uuid': '65d38b07-ae24-4f58-835e-816f2057b6e8'} 06/02/2025 02:07:48.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:48.847 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'show_mac_mob_template'] not found in DB: Unknown id: job_template default-global-system-config:show_mac_mob_template 06/02/2025 02:07:48.856 7fad860882e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_mac_mob_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_mac_mob_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"mac_details\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"MAC Details\", \"type\": \"object\", \"properties\": {\"mac_address\": {\"$id\": \"/properties/mac_address\", \"title\": \"Mac Address\", \"pattern\": \"^\\\\s*([A-Fa-f0-9]{2}(:{1}[A-Fa-f0-9]{2}){5})\\\\s*$\", \"type\": \"string\"}}, \"required\": [\"mac_address\"]}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show MAC mobility Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"MAC History\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "{\"mac_details\": {\"mac_address\": {\"ui:help\": \"Enter a 48 bit MAC address in colon separated format; for example, 00:00:0A:BB:28:FC\", \"ui:placeholder\": \"Enter MAC address\"}}}", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to display MAC address move or mobility", "display_name": "Show mac mobility", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.856 7fad860882e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_mac_mob_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_mac_mob_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"mac_details\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"MAC Details\", \"type\": \"object\", \"properties\": {\"mac_address\": {\"$id\": \"/properties/mac_address\", \"title\": \"Mac Address\", \"pattern\": \"^\\\\s*([A-Fa-f0-9]{2}(:{1}[A-Fa-f0-9]{2}){5})\\\\s*$\", \"type\": \"string\"}}, \"required\": [\"mac_address\"]}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show MAC mobility Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"MAC History\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "{\"mac_details\": {\"mac_address\": {\"ui:help\": \"Enter a 48 bit MAC address in colon separated format; for example, 00:00:0A:BB:28:FC\", \"ui:placeholder\": \"Enter MAC address\"}}}", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to display MAC address move or mobility", "display_name": "Show mac mobility", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:48.930 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'show_mac_mob_template'], 'obj_dict': {'display_name': 'Show mac mobility', 'fq_name': ['default-global-system-config', 'show_mac_mob_template'], 'id_perms': {'created': '2025-06-02T02:07:48.872044', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:48.872044', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12102376608048886941, 'uuid_mslong': 18360547617033571256}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display MAC ' 'address move or mobility', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"mac_details": ' '{"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "MAC Details", "type": ' '"object", "properties": ' '{"mac_address": {"$id": ' '"/properties/mac_address", ' '"title": "Mac Address", "pattern": ' '"^\\\\s*([A-Fa-f0-9]{2}(:{1}[A-Fa-f0-9]{2}){5})\\\\s*$", ' '"type": "string"}}, "required": ' '["mac_address"]}}}', 'job_template_input_ui_schema': '{"mac_details": {"mac_address": ' '{"ui:help": "Enter a 48 bit MAC ' 'address in colon separated ' 'format; for example, ' '00:00:0A:BB:28:FC", ' '"ui:placeholder": "Enter MAC ' 'address"}}}', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show MAC mobility ' 'Output", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "MAC History", ' '"description": "Display Device ' 'Configuration output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fecdc4c7-82ee-4bb8-a7f4-476764c0349d'}, 'oper': 'CREATE', 'request-id': 'req-2a47cd77-9bae-4f5e-9c47-db7c4874c0eb', 'type': 'job_template', 'uuid': 'fecdc4c7-82ee-4bb8-a7f4-476764c0349d'} 06/02/2025 02:07:49.033 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'rma_activate_template'] not found in DB: Unknown id: job_template default-global-system-config:rma_activate_template 06/02/2025 02:07:49.040 7fad86267390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:rma_activate_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "rma_activate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/rma_activate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 1}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 2}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 20, "sequence_no": 3}]}, "job_template_recovery_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": null, "device_family": null, "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"RMA activate\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"rma_devices\": {\"type\": \"array\", \"items\": {\"title\": \"RMA Devices\", \"type\": \"object\", \"description\": \"List of devices and corresponding serial numbers to RMA\", \"additionalProperties\": false, \"properties\": {\"device_uuid\": {\"type\": \"string\", \"format\": \"uuid\"}, \"serial_number\": {\"type\": \"string\"}}, \"required\": [\"device_uuid\", \"serial_number\"]}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "RMA Activation", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:49.040 7fad86267390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:rma_activate_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "rma_activate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/rma_activate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 1}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 2}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 20, "sequence_no": 3}]}, "job_template_recovery_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": null, "device_family": null, "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"RMA activate\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"rma_devices\": {\"type\": \"array\", \"items\": {\"title\": \"RMA Devices\", \"type\": \"object\", \"description\": \"List of devices and corresponding serial numbers to RMA\", \"additionalProperties\": false, \"properties\": {\"device_uuid\": {\"type\": \"string\", \"format\": \"uuid\"}, \"serial_number\": {\"type\": \"string\"}}, \"required\": [\"device_uuid\", \"serial_number\"]}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "RMA Activation", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:49.127 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rma_activate_template'], 'obj_dict': {'display_name': 'RMA Activation', 'fq_name': ['default-global-system-config', 'rma_activate_template'], 'id_perms': {'created': '2025-06-02T02:07:49.058131', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:49.058131', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12705498179786082917, 'uuid_mslong': 5966904439515267574}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "RMA activate", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"type": "string", "description": ' '"Fabric UUID"}, "rma_devices": ' '{"type": "array", "items": ' '{"title": "RMA Devices", "type": ' '"object", "description": "List of ' 'devices and corresponding serial ' 'numbers to RMA", ' '"additionalProperties": false, ' '"properties": {"device_uuid": ' '{"type": "string", "format": ' '"uuid"}, "serial_number": {"type": ' '"string"}}, "required": ' '["device_uuid", ' '"serial_number"]}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/rma_activate.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 50, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml', 'refresh_token': False, 'sequence_no': 2, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 20, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': 3, 'vendor': 'Juniper'}]}, 'job_template_recovery_playbooks': {'playbook_info': [{'device_family': None, 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': None}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '52ceb3f9-4602-41f6-b052-ff4724858a65'}, 'oper': 'CREATE', 'request-id': 'req-ee6a1e39-73d7-44af-89a6-a3a3ee7aa97a', 'type': 'job_template', 'uuid': '52ceb3f9-4602-41f6-b052-ff4724858a65'} 06/02/2025 02:07:49.213 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'show_chassis_info_template'] not found in DB: Unknown id: job_template default-global-system-config:show_chassis_info_template 06/02/2025 02:07:49.218 7fad854b4c18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_chassis_info_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_chassis_info_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"chassis\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"Chassis information\", \"type\": \"object\", \"properties\": {\"chassis_detail\": {\"$id\": \"/properties/chassis_detail\", \"title\": \"Chassis detail\", \"type\": \"string\", \"enum\": [\"chassis alarms\", \"chassis environment\", \"chassis environment cb\", \"chassis environment fpc\", \"chassis environment pem\", \"chassis environment routing-engine\", \"chassis fpc detail\", \"chassis fan\", \"chassis firmware\", \"chassis mac-addresses\", \"chassis routing-engine\", \"chassis power\", \"chassis hardware\", \"chassis hardware detail\", \"chassis hardware clei-models\", \"chassis temperature-thresholds\"], \"default\": \"chassis hardware\"}}, \"required\": [\"chassis_detail\"]}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show chassis Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Chassis info\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to display chassis information", "display_name": "Show chassis information", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:49.218 7fad854b4c18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_chassis_info_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_chassis_info_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"chassis\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"Chassis information\", \"type\": \"object\", \"properties\": {\"chassis_detail\": {\"$id\": \"/properties/chassis_detail\", \"title\": \"Chassis detail\", \"type\": \"string\", \"enum\": [\"chassis alarms\", \"chassis environment\", \"chassis environment cb\", \"chassis environment fpc\", \"chassis environment pem\", \"chassis environment routing-engine\", \"chassis fpc detail\", \"chassis fan\", \"chassis firmware\", \"chassis mac-addresses\", \"chassis routing-engine\", \"chassis power\", \"chassis hardware\", \"chassis hardware detail\", \"chassis hardware clei-models\", \"chassis temperature-thresholds\"], \"default\": \"chassis hardware\"}}, \"required\": [\"chassis_detail\"]}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show chassis Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Chassis info\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to display chassis information", "display_name": "Show chassis information", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:49.292 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'show_chassis_info_template'], 'obj_dict': {'display_name': 'Show chassis information', 'fq_name': ['default-global-system-config', 'show_chassis_info_template'], 'id_perms': {'created': '2025-06-02T02:07:49.232190', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:49.232190', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10889738072678900830, 'uuid_mslong': 14383391254242216859}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display ' 'chassis information', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"chassis": {"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "Chassis information", ' '"type": "object", "properties": ' '{"chassis_detail": {"$id": ' '"/properties/chassis_detail", ' '"title": "Chassis detail", "type": ' '"string", "enum": ["chassis ' 'alarms", "chassis environment", ' '"chassis environment cb", "chassis ' 'environment fpc", "chassis ' 'environment pem", "chassis ' 'environment routing-engine", ' '"chassis fpc detail", "chassis ' 'fan", "chassis firmware", "chassis ' 'mac-addresses", "chassis ' 'routing-engine", "chassis power", ' '"chassis hardware", "chassis ' 'hardware detail", "chassis ' 'hardware clei-models", "chassis ' 'temperature-thresholds"], ' '"default": "chassis hardware"}}, ' '"required": ["chassis_detail"]}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show chassis Output", ' '"type": "object", "properties": ' '{"results": {"type": "array", ' '"description": "Array holding the ' 'specific output details in case ' 'of success. Each object of the ' 'array would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "Chassis ' 'info", "description": "Display ' 'Device Configuration ' 'output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c79c1223-a691-4b9b-9720-1f14af12a45e'}, 'oper': 'CREATE', 'request-id': 'req-e2530ef7-2707-4cda-9567-cca936d81f24', 'type': 'job_template', 'uuid': 'c79c1223-a691-4b9b-9720-1f14af12a45e'} 06/02/2025 02:07:49.388 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'hardware_inventory_template'] not found in DB: Unknown id: job_template default-global-system-config:hardware_inventory_template 06/02/2025 02:07:49.394 7fad85442d68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:hardware_inventory_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "hardware_inventory_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Hardware Inventory Information\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"minProperties\": 1}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to fetch hardware inventory information from the device", "display_name": "Fetch hardware chassis information", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:49.394 7fad85442d68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:hardware_inventory_template url = https://10.0.0.129:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "hardware_inventory_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Hardware Inventory Information\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"minProperties\": 1}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to fetch hardware inventory information from the device", "display_name": "Fetch hardware chassis information", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:49.460 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 06/02/2025 02:07:49.460 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 06/02/2025 02:07:49.460 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 06/02/2025 02:07:49.460 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 06/02/2025 02:07:49.460 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 06/02/2025 02:07:49.460 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 06/02/2025 02:07:49.460 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 06/02/2025 02:07:49.460 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 06/02/2025 02:07:49.461 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 06/02/2025 02:07:49.462 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 06/02/2025 02:07:49.462 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 06/02/2025 02:07:49.462 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 06/02/2025 02:07:49.462 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 06/02/2025 02:07:49.462 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 06/02/2025 02:07:49.462 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 06/02/2025 02:07:49.462 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 06/02/2025 02:07:49.462 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 06/02/2025 02:07:49.462 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 06/02/2025 02:07:49.462 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 06/02/2025 02:07:49.462 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 06/02/2025 02:07:49.471 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'hardware_inventory_template'], 'obj_dict': {'display_name': 'Fetch hardware chassis information', 'fq_name': ['default-global-system-config', 'hardware_inventory_template'], 'id_perms': {'created': '2025-06-02T02:07:49.408720', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:49.408720', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12150361800658403987, 'uuid_mslong': 189910856552826368}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to fetch ' 'hardware inventory information from ' 'the device', 'job_template_input_schema': '{"title": "Hardware Inventory ' 'Information", "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", "minProperties": ' '1}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '02a2b2ea-f7d2-4600-a89e-c1aeacb84293'}, 'oper': 'CREATE', 'request-id': 'req-0413396b-d025-4734-b84b-94e56b2d18e4', 'type': 'job_template', 'uuid': '02a2b2ea-f7d2-4600-a89e-c1aeacb84293'} 06/02/2025 02:07:49.572 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'config_property'] not found in DB: Unknown id: config_properties default-global-system-config:config_property 06/02/2025 02:07:49.575 7fad86c2d2e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'] not found in DB: Unknown id: config_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 06/02/2025 02:07:49.587 7fad85c48ac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_properties identifier_name = default-global-system-config:config_property url = https://10.0.0.129:8082/config-propertiess operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"config-properties": {"uuid": null, "fq_name": ["default-global-system-config", "config_property"], "parent_type": "global-system-config", "properties": {"key_value_pair": [{"key": "junos_commit_timeout", "value": "600"}, {"key": "total_retry_timeout", "value": "600"}, {"key": "device_command_timeout", "value": "600"}, {"key": "ztp_timeout", "value": "570"}]}, "display_name": "Config Property", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:49.587 7fad85c48ac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_properties identifier_name = default-global-system-config:config_property url = https://10.0.0.129:8082/config-propertiess operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"config-properties": {"uuid": null, "fq_name": ["default-global-system-config", "config_property"], "parent_type": "global-system-config", "properties": {"key_value_pair": [{"key": "junos_commit_timeout", "value": "600"}, {"key": "total_retry_timeout", "value": "600"}, {"key": "device_command_timeout", "value": "600"}, {"key": "ztp_timeout", "value": "570"}]}, "display_name": "Config Property", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:49.592 7fad854424e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/config-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.129 body = {"config-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "global-system-config", "config_node_ip_address": "10.0.0.129", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:49.593 7fad854424e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/config-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.129 body = {"config-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "global-system-config", "config_node_ip_address": "10.0.0.129", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:49.654 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'config_property'], 'obj_dict': {'display_name': 'Config Property', 'fq_name': ['default-global-system-config', 'config_property'], 'id_perms': {'created': '2025-06-02T02:07:49.613013', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:49.613013', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9792739549316609497, 'uuid_mslong': 17403667063100361545}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'properties': {'key_value_pair': [{'key': 'junos_commit_timeout', 'value': '600'}, {'key': 'total_retry_timeout', 'value': '600'}, {'key': 'device_command_timeout', 'value': '600'}, {'key': 'ztp_timeout', 'value': '570'}]}, 'uuid': 'f1863efc-3d43-4b49-87e6-ccbc66ef75d9'}, 'oper': 'CREATE', 'request-id': 'req-f520e2ed-6e8d-4168-9c04-aad8985e7655', 'type': 'config_properties', 'uuid': 'f1863efc-3d43-4b49-87e6-ccbc66ef75d9'} 06/02/2025 02:07:49.663 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'obj_dict': {'config_node_ip_address': '10.0.0.129', 'display_name': 'cn-jenkins-deploy-platform-juju-os-542-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'id_perms': {'created': '2025-06-02T02:07:49.634580', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:49.634580', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11270785127697551173, 'uuid_mslong': 4628382002360502182}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '403b50e8-af82-47a6-9c69-df5bc42b0f45'}, 'oper': 'CREATE', 'request-id': 'req-0f6af2e5-2ec6-42f8-bdae-25ea4c779641', 'type': 'config_node', 'uuid': '403b50e8-af82-47a6-9c69-df5bc42b0f45'} 06/02/2025 02:07:49.664 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:ContrailConfigTrace] map 06/02/2025 02:07:49.756 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['label=fabric-management-ip'] not found in DB: Unknown id: tag label=fabric-management-ip 06/02/2025 02:07:49.757 7fad8535ab70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-management-ip url = https://10.0.0.129:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-management-ip"], "tag_type_name": "label", "tag_value": "fabric-management-ip", "tag_predefined": true, "name": "label=fabric-management-ip", "display_name": "label=fabric-management-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:49.757 7fad8535ab70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-management-ip url = https://10.0.0.129:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-management-ip"], "tag_type_name": "label", "tag_value": "fabric-management-ip", "tag_predefined": true, "name": "label=fabric-management-ip", "display_name": "label=fabric-management-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:49.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:49.828 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label=fabric-management-ip'], 'obj_dict': {'display_name': 'label=fabric-management-ip', 'fq_name': ['label=fabric-management-ip'], 'id_perms': {'created': '2025-06-02T02:07:49.810913', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:49.810913', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13635903918554517172, 'uuid_mslong': 5744453937340761771}}, 'name': 'label=fabric-management-ip', 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000000', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': '1311cd87-1e77-4a0e-b031-c3e67ab4e6f1'}], 'tag_value': 'fabric-management-ip', 'uuid': '4fb8666b-abca-46ab-bd3c-765e28cc8eb4'}, 'oper': 'CREATE', 'request-id': 'req-13dc9633-1688-4d8d-b3ea-46aff215a69d', 'type': 'tag', 'uuid': '4fb8666b-abca-46ab-bd3c-765e28cc8eb4'} 06/02/2025 02:07:49.828 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 06/02/2025 02:07:49.925 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['label=fabric-loopback-ip'] not found in DB: Unknown id: tag label=fabric-loopback-ip 06/02/2025 02:07:49.928 7fad85353438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-loopback-ip url = https://10.0.0.129:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-loopback-ip"], "tag_type_name": "label", "tag_value": "fabric-loopback-ip", "tag_predefined": true, "name": "label=fabric-loopback-ip", "display_name": "label=fabric-loopback-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:49.928 7fad85353438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-loopback-ip url = https://10.0.0.129:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-loopback-ip"], "tag_type_name": "label", "tag_value": "fabric-loopback-ip", "tag_predefined": true, "name": "label=fabric-loopback-ip", "display_name": "label=fabric-loopback-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:49.973 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label=fabric-loopback-ip'], 'obj_dict': {'display_name': 'label=fabric-loopback-ip', 'fq_name': ['label=fabric-loopback-ip'], 'id_perms': {'created': '2025-06-02T02:07:49.954056', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:49.954056', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9480527735110400151, 'uuid_mslong': 13601467295424530467}}, 'name': 'label=fabric-loopback-ip', 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000001', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': '1311cd87-1e77-4a0e-b031-c3e67ab4e6f1'}], 'tag_value': 'fabric-loopback-ip', 'uuid': 'bcc21e71-07df-4823-8391-99bebe7e7897'}, 'oper': 'CREATE', 'request-id': 'req-85c7732e-dee4-4d2d-9440-480a9d9aaa5b', 'type': 'tag', 'uuid': 'bcc21e71-07df-4823-8391-99bebe7e7897'} 06/02/2025 02:07:49.974 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 06/02/2025 02:07:50.081 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['label=fabric-overlay-loopback-ip'] not found in DB: Unknown id: tag label=fabric-overlay-loopback-ip 06/02/2025 02:07:50.083 7fad86255978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-overlay-loopback-ip url = https://10.0.0.129:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-overlay-loopback-ip"], "tag_type_name": "label", "tag_value": "fabric-overlay-loopback-ip", "tag_predefined": true, "name": "label=fabric-overlay-loopback-ip", "display_name": "label=fabric-overlay-loopback-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:50.084 7fad86255978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-overlay-loopback-ip url = https://10.0.0.129:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-overlay-loopback-ip"], "tag_type_name": "label", "tag_value": "fabric-overlay-loopback-ip", "tag_predefined": true, "name": "label=fabric-overlay-loopback-ip", "display_name": "label=fabric-overlay-loopback-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:50.143 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label=fabric-overlay-loopback-ip'], 'obj_dict': {'display_name': 'label=fabric-overlay-loopback-ip', 'fq_name': ['label=fabric-overlay-loopback-ip'], 'id_perms': {'created': '2025-06-02T02:07:50.116242', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:50.116242', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11649412711423729875, 'uuid_mslong': 11018191656654750208}}, 'name': 'label=fabric-overlay-loopback-ip', 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000002', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': '1311cd87-1e77-4a0e-b031-c3e67ab4e6f1'}], 'tag_value': 'fabric-overlay-loopback-ip', 'uuid': '98e87aef-5214-4200-a1ab-0723ca54e0d3'}, 'oper': 'CREATE', 'request-id': 'req-d22b15d6-6054-454c-93c2-dbf04eacdb63', 'type': 'tag', 'uuid': '98e87aef-5214-4200-a1ab-0723ca54e0d3'} 06/02/2025 02:07:50.143 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 06/02/2025 02:07:50.249 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['label=fabric-peer-ip'] not found in DB: Unknown id: tag label=fabric-peer-ip 06/02/2025 02:07:50.250 7fad85815438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-peer-ip url = https://10.0.0.129:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-peer-ip"], "tag_type_name": "label", "tag_value": "fabric-peer-ip", "tag_predefined": true, "name": "label=fabric-peer-ip", "display_name": "label=fabric-peer-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:50.250 7fad85815438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-peer-ip url = https://10.0.0.129:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-peer-ip"], "tag_type_name": "label", "tag_value": "fabric-peer-ip", "tag_predefined": true, "name": "label=fabric-peer-ip", "display_name": "label=fabric-peer-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:50.292 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label=fabric-peer-ip'], 'obj_dict': {'display_name': 'label=fabric-peer-ip', 'fq_name': ['label=fabric-peer-ip'], 'id_perms': {'created': '2025-06-02T02:07:50.274101', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:50.274101', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10736120122520308815, 'uuid_mslong': 17602382620745744532}}, 'name': 'label=fabric-peer-ip', 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000003', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': '1311cd87-1e77-4a0e-b031-c3e67ab4e6f1'}], 'tag_value': 'fabric-peer-ip', 'uuid': 'f44839bb-6e0f-4094-94fe-5c5e78bf0c4f'}, 'oper': 'CREATE', 'request-id': 'req-49acf9aa-dce1-4b61-8217-aebc0311eb05', 'type': 'tag', 'uuid': 'f44839bb-6e0f-4094-94fe-5c5e78bf0c4f'} 06/02/2025 02:07:50.293 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 06/02/2025 02:07:50.388 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['label=fabric-pnf-servicechain-ip'] not found in DB: Unknown id: tag label=fabric-pnf-servicechain-ip 06/02/2025 02:07:50.389 7fad8583bcc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-pnf-servicechain-ip url = https://10.0.0.129:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-pnf-servicechain-ip"], "tag_type_name": "label", "tag_value": "fabric-pnf-servicechain-ip", "tag_predefined": true, "name": "label=fabric-pnf-servicechain-ip", "display_name": "label=fabric-pnf-servicechain-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:50.389 7fad8583bcc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-pnf-servicechain-ip url = https://10.0.0.129:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-pnf-servicechain-ip"], "tag_type_name": "label", "tag_value": "fabric-pnf-servicechain-ip", "tag_predefined": true, "name": "label=fabric-pnf-servicechain-ip", "display_name": "label=fabric-pnf-servicechain-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:50.441 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label=fabric-pnf-servicechain-ip'], 'obj_dict': {'display_name': 'label=fabric-pnf-servicechain-ip', 'fq_name': ['label=fabric-pnf-servicechain-ip'], 'id_perms': {'created': '2025-06-02T02:07:50.424621', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:50.424621', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11320097017832191850, 'uuid_mslong': 17773949783267561330}}, 'name': 'label=fabric-pnf-servicechain-ip', 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000004', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': '1311cd87-1e77-4a0e-b031-c3e67ab4e6f1'}], 'tag_value': 'fabric-pnf-servicechain-ip', 'uuid': 'f6a9c128-4f4b-4f72-9d19-1042e2d8b76a'}, 'oper': 'CREATE', 'request-id': 'req-b3fef89d-a408-47ae-a890-78c48f2283c0', 'type': 'tag', 'uuid': 'f6a9c128-4f4b-4f72-9d19-1042e2d8b76a'} 06/02/2025 02:07:50.442 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 06/02/2025 02:07:50.543 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['label=fabric-as-number'] not found in DB: Unknown id: tag label=fabric-as-number 06/02/2025 02:07:50.544 7fad853ab630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-as-number url = https://10.0.0.129:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-as-number"], "tag_type_name": "label", "tag_value": "fabric-as-number", "tag_predefined": true, "name": "label=fabric-as-number", "display_name": "label=fabric-as-number", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:50.544 7fad853ab630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-as-number url = https://10.0.0.129:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-as-number"], "tag_type_name": "label", "tag_value": "fabric-as-number", "tag_predefined": true, "name": "label=fabric-as-number", "display_name": "label=fabric-as-number", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:50.587 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label=fabric-as-number'], 'obj_dict': {'display_name': 'label=fabric-as-number', 'fq_name': ['label=fabric-as-number'], 'id_perms': {'created': '2025-06-02T02:07:50.572758', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:50.572758', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13154864950404860147, 'uuid_mslong': 7168961639643041397}}, 'name': 'label=fabric-as-number', 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000005', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': '1311cd87-1e77-4a0e-b031-c3e67ab4e6f1'}], 'tag_value': 'fabric-as-number', 'uuid': '637d44a0-e353-4e75-b68f-77f9951e48f3'}, 'oper': 'CREATE', 'request-id': 'req-2b92e41c-821b-4818-9132-6923e79a8477', 'type': 'tag', 'uuid': '637d44a0-e353-4e75-b68f-77f9951e48f3'} 06/02/2025 02:07:50.587 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 06/02/2025 02:07:50.700 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['label=fabric-ebgp-as-number'] not found in DB: Unknown id: tag label=fabric-ebgp-as-number 06/02/2025 02:07:50.701 7fad8552d978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-ebgp-as-number url = https://10.0.0.129:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-ebgp-as-number"], "tag_type_name": "label", "tag_value": "fabric-ebgp-as-number", "tag_predefined": true, "name": "label=fabric-ebgp-as-number", "display_name": "label=fabric-ebgp-as-number", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:50.701 7fad8552d978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-ebgp-as-number url = https://10.0.0.129:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-ebgp-as-number"], "tag_type_name": "label", "tag_value": "fabric-ebgp-as-number", "tag_predefined": true, "name": "label=fabric-ebgp-as-number", "display_name": "label=fabric-ebgp-as-number", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:50.732 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label=fabric-ebgp-as-number'], 'obj_dict': {'display_name': 'label=fabric-ebgp-as-number', 'fq_name': ['label=fabric-ebgp-as-number'], 'id_perms': {'created': '2025-06-02T02:07:50.720439', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:50.720439', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12505833211747514519, 'uuid_mslong': 13042016790813165269}}, 'name': 'label=fabric-ebgp-as-number', 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000006', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': '1311cd87-1e77-4a0e-b031-c3e67ab4e6f1'}], 'tag_value': 'fabric-ebgp-as-number', 'uuid': 'b4fe8d2b-f319-46d5-ad8d-a50c1e7e3897'}, 'oper': 'CREATE', 'request-id': 'req-39815afe-99d6-4e27-9cc3-b0ce80730954', 'type': 'tag', 'uuid': 'b4fe8d2b-f319-46d5-ad8d-a50c1e7e3897'} 06/02/2025 02:07:50.732 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 06/02/2025 02:07:50.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:50.824 7fad853ab438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3b45d35b-de57-4285-b542-427e524b5c84 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.129:8082/global-system-config/3b45d35b-de57-4285-b542-427e524b5c84 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"global-system-config": {"uuid": "3b45d35b-de57-4285-b542-427e524b5c84", "fq_name": ["default-global-system-config"], "supported_device_families": {"device_family": ["junos", "junos-qfx"]}, "supported_vendor_hardwares": {"vendor_hardware": ["juniper-qfx10002-72q", "juniper-qfx10002-36q", "juniper-qfx10002-60c", "juniper-qfx10016", "juniper-qfx10008", "juniper-vqfx-10000", "juniper-qfx5100-48sh-afi", "juniper-qfx5100-48sh-afo", "juniper-qfx5100-48th-afi", "juniper-qfx5100-48th-afo", "juniper-qfx5100-48s-6q", "juniper-qfx5100-96s-8q", "juniper-qfx5100-48t", "juniper-qfx5100-48t-6q", "juniper-qfx5100-24q-2p", "juniper-qfx5100-24q-aa", "juniper-qfx5100e-48s-6q", "juniper-qfx5100e-96s-8q", "juniper-qfx5100e-48t-6q", "juniper-qfx5100e-24q-2p", "juniper-qfx5110-48s-4c", "juniper-qfx5110-32q", "juniper-qfx5120-48y-8c", "juniper-qfx5120-48t-6c", "juniper-qfx5120-32c", "juniper-qfx5220-32cd", "juniper-qfx5220-128c", "juniper-qfx5200-32c-32q", "juniper-qfx5200-48y", "juniper-qfx5210-64c", "juniper-vmx", "juniper-mx80", "juniper-mx80-48t", "juniper-mx204", "juniper-mx240", "juniper-mx480", "juniper-mx960", "juniper-mx2008", "juniper-mx2010", "juniper-mx2020", "juniper-mx10003", "juniper-jnp10008", "juniper-jnp10016", "juniper-srx5400", "juniper-srx5600", "juniper-srx4600", "juniper-srx4100", "juniper-srx1500", "juniper-srx240h-poe", "juniper-vsrx", "juniper-srx5800", "juniper-srx4200"]}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:50.825 7fad853ab438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3b45d35b-de57-4285-b542-427e524b5c84 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.129:8082/global-system-config/3b45d35b-de57-4285-b542-427e524b5c84 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"global-system-config": {"uuid": "3b45d35b-de57-4285-b542-427e524b5c84", "fq_name": ["default-global-system-config"], "supported_device_families": {"device_family": ["junos", "junos-qfx"]}, "supported_vendor_hardwares": {"vendor_hardware": ["juniper-qfx10002-72q", "juniper-qfx10002-36q", "juniper-qfx10002-60c", "juniper-qfx10016", "juniper-qfx10008", "juniper-vqfx-10000", "juniper-qfx5100-48sh-afi", "juniper-qfx5100-48sh-afo", "juniper-qfx5100-48th-afi", "juniper-qfx5100-48th-afo", "juniper-qfx5100-48s-6q", "juniper-qfx5100-96s-8q", "juniper-qfx5100-48t", "juniper-qfx5100-48t-6q", "juniper-qfx5100-24q-2p", "juniper-qfx5100-24q-aa", "juniper-qfx5100e-48s-6q", "juniper-qfx5100e-96s-8q", "juniper-qfx5100e-48t-6q", "juniper-qfx5100e-24q-2p", "juniper-qfx5110-48s-4c", "juniper-qfx5110-32q", "juniper-qfx5120-48y-8c", "juniper-qfx5120-48t-6c", "juniper-qfx5120-32c", "juniper-qfx5220-32cd", "juniper-qfx5220-128c", "juniper-qfx5200-32c-32q", "juniper-qfx5200-48y", "juniper-qfx5210-64c", "juniper-vmx", "juniper-mx80", "juniper-mx80-48t", "juniper-mx204", "juniper-mx240", "juniper-mx480", "juniper-mx960", "juniper-mx2008", "juniper-mx2010", "juniper-mx2020", "juniper-mx10003", "juniper-jnp10008", "juniper-jnp10016", "juniper-srx5400", "juniper-srx5600", "juniper-srx4600", "juniper-srx4100", "juniper-srx1500", "juniper-srx240h-poe", "juniper-vsrx", "juniper-srx5800", "juniper-srx4200"]}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:50.845 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-61a7baf7-eabb-4cd3-8780-c318c0ed474d', 'type': 'global_system_config', 'uuid': '3b45d35b-de57-4285-b542-427e524b5c84'} 06/02/2025 02:07:50.944 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-48sh-afi'] not found in DB: Unknown id: hardware juniper-qfx5100-48sh-afi 06/02/2025 02:07:50.945 7fad854af198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48sh-afi url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48sh-afi"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48sh-afi"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:50.945 7fad854af198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48sh-afi url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48sh-afi"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48sh-afi"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:50.959 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-48sh-afi'], 'obj_dict': {'display_name': 'juniper-qfx5100-48sh-afi', 'fq_name': ['juniper-qfx5100-48sh-afi'], 'id_perms': {'created': '2025-06-02T02:07:50.951824', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:50.951824', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10351727501422385491, 'uuid_mslong': 10599271244893212439}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '93182d0a-35df-4f17-8fa8-b95115ec5953'}, 'oper': 'CREATE', 'request-id': 'req-64c996e1-85ab-478b-ab77-0bccf3dff8a9', 'type': 'hardware', 'uuid': '93182d0a-35df-4f17-8fa8-b95115ec5953'} 06/02/2025 02:07:51.062 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-48sh-afo'] not found in DB: Unknown id: hardware juniper-qfx5100-48sh-afo 06/02/2025 02:07:51.063 7fad89579828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48sh-afo url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48sh-afo"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48sh-afo"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.063 7fad89579828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48sh-afo url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48sh-afo"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48sh-afo"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.078 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-48sh-afo'], 'obj_dict': {'display_name': 'juniper-qfx5100-48sh-afo', 'fq_name': ['juniper-qfx5100-48sh-afo'], 'id_perms': {'created': '2025-06-02T02:07:51.071061', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:51.071061', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13243446131484055006, 'uuid_mslong': 17642794079016341262}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'f4d7cbbd-4522-4f0e-b7ca-2c16fd20d5de'}, 'oper': 'CREATE', 'request-id': 'req-e824a7b7-ff11-4c0b-8501-2eb7fef80690', 'type': 'hardware', 'uuid': 'f4d7cbbd-4522-4f0e-b7ca-2c16fd20d5de'} 06/02/2025 02:07:51.188 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-48th-afi'] not found in DB: Unknown id: hardware juniper-qfx5100-48th-afi 06/02/2025 02:07:51.190 7fad853abe10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48th-afi url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48th-afi"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48th-afi"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.190 7fad853abe10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48th-afi url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48th-afi"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48th-afi"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.221 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-48th-afi'], 'obj_dict': {'display_name': 'juniper-qfx5100-48th-afi', 'fq_name': ['juniper-qfx5100-48th-afi'], 'id_perms': {'created': '2025-06-02T02:07:51.203803', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:51.203803', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10648176766485786346, 'uuid_mslong': 10568614640208530229}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '92ab4305-359f-4b35-93c5-ec5a47f3eeea'}, 'oper': 'CREATE', 'request-id': 'req-e08b9c4a-79ef-42e0-9f97-0eab52125b4f', 'type': 'hardware', 'uuid': '92ab4305-359f-4b35-93c5-ec5a47f3eeea'} 06/02/2025 02:07:51.232 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 06/02/2025 02:07:51.237 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 06/02/2025 02:07:51.237 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 06/02/2025 02:07:51.237 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 06/02/2025 02:07:51.237 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 06/02/2025 02:07:51.237 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 06/02/2025 02:07:51.237 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 06/02/2025 02:07:51.237 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 06/02/2025 02:07:51.237 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 06/02/2025 02:07:51.237 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 06/02/2025 02:07:51.238 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 06/02/2025 02:07:51.238 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 06/02/2025 02:07:51.238 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 06/02/2025 02:07:51.238 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 06/02/2025 02:07:51.238 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 06/02/2025 02:07:51.238 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 06/02/2025 02:07:51.238 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 06/02/2025 02:07:51.238 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 06/02/2025 02:07:51.238 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 06/02/2025 02:07:51.238 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 06/02/2025 02:07:51.238 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 06/02/2025 02:07:51.238 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 06/02/2025 02:07:51.239 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 06/02/2025 02:07:51.239 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 06/02/2025 02:07:51.239 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 06/02/2025 02:07:51.239 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 06/02/2025 02:07:51.239 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 06/02/2025 02:07:51.239 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 06/02/2025 02:07:51.239 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 06/02/2025 02:07:51.239 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 06/02/2025 02:07:51.239 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 06/02/2025 02:07:51.239 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 06/02/2025 02:07:51.239 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 06/02/2025 02:07:51.239 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 06/02/2025 02:07:51.318 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-48th-afo'] not found in DB: Unknown id: hardware juniper-qfx5100-48th-afo 06/02/2025 02:07:51.319 7fad8543a240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48th-afo url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48th-afo"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48th-afo"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.320 7fad8543a240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48th-afo url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48th-afo"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48th-afo"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.338 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-48th-afo'], 'obj_dict': {'display_name': 'juniper-qfx5100-48th-afo', 'fq_name': ['juniper-qfx5100-48th-afo'], 'id_perms': {'created': '2025-06-02T02:07:51.325789', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:51.325789', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13229688566447896878, 'uuid_mslong': 17562994319616984432}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'f3bc4a47-ecf9-4570-b799-4ba8442c792e'}, 'oper': 'CREATE', 'request-id': 'req-b9e5ee63-de47-44ca-aa2e-88c4a6768888', 'type': 'hardware', 'uuid': 'f3bc4a47-ecf9-4570-b799-4ba8442c792e'} 06/02/2025 02:07:51.344 7fad86931438 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'] not found in DB: Unknown id: config_database_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 06/02/2025 02:07:51.353 7fad854cbc18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/config-database-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.129 body = {"config-database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "global-system-config", "config_database_node_ip_address": "10.0.0.129", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.354 7fad854cbc18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/config-database-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.129 body = {"config-database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "global-system-config", "config_database_node_ip_address": "10.0.0.129", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.402 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'obj_dict': {'config_database_node_ip_address': '10.0.0.129', 'display_name': 'cn-jenkins-deploy-platform-juju-os-542-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'id_perms': {'created': '2025-06-02T02:07:51.371476', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:51.371476', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10170344549174564906, 'uuid_mslong': 11456962236864940913}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9eff4e73-ed66-4b71-8d24-527b90e1582a'}, 'oper': 'CREATE', 'request-id': 'req-c3bdc6e2-5127-4cca-9ee1-478d96c64c7c', 'type': 'config_database_node', 'uuid': '9eff4e73-ed66-4b71-8d24-527b90e1582a'} 06/02/2025 02:07:51.403 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigDatabaseInfo:ContrailConfigTrace] map 06/02/2025 02:07:51.442 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-48s-6q'] not found in DB: Unknown id: hardware juniper-qfx5100-48s-6q 06/02/2025 02:07:51.443 7fad8582ceb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48s-6q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48s-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48s-6q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.443 7fad8582ceb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48s-6q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48s-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48s-6q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.472 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-48s-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100-48s-6q', 'fq_name': ['juniper-qfx5100-48s-6q'], 'id_perms': {'created': '2025-06-02T02:07:51.460257', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:51.460257', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11017364345282910440, 'uuid_mslong': 8739585594052592421}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '79493ecb-21a0-4325-98e5-8a7fe1a458e8'}, 'oper': 'CREATE', 'request-id': 'req-0a2d63a5-c98b-4e59-8d42-3cfdaa089a76', 'type': 'hardware', 'uuid': '79493ecb-21a0-4325-98e5-8a7fe1a458e8'} 06/02/2025 02:07:51.563 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-96s-8q'] not found in DB: Unknown id: hardware juniper-qfx5100-96s-8q 06/02/2025 02:07:51.565 7fad855ca048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-96s-8q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-96s-8q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-96s-8q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.565 7fad855ca048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-96s-8q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-96s-8q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-96s-8q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.582 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-96s-8q'], 'obj_dict': {'display_name': 'juniper-qfx5100-96s-8q', 'fq_name': ['juniper-qfx5100-96s-8q'], 'id_perms': {'created': '2025-06-02T02:07:51.572293', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:51.572293', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12699524279376111365, 'uuid_mslong': 3864079917185060264}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '359ff836-3f89-4da8-b03d-c60c10a96705'}, 'oper': 'CREATE', 'request-id': 'req-2b8d68d2-f92f-4188-9779-e55f73e4c150', 'type': 'hardware', 'uuid': '359ff836-3f89-4da8-b03d-c60c10a96705'} 06/02/2025 02:07:51.679 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-48t'] not found in DB: Unknown id: hardware juniper-qfx5100-48t 06/02/2025 02:07:51.680 7fad8606a240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48t url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48t"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48t"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.681 7fad8606a240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48t url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48t"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48t"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.697 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-48t'], 'obj_dict': {'display_name': 'juniper-qfx5100-48t', 'fq_name': ['juniper-qfx5100-48t'], 'id_perms': {'created': '2025-06-02T02:07:51.687692', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:51.687692', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13152730976703415853, 'uuid_mslong': 17089731937074171876}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'ed2aeca6-c7f4-4fe4-b687-e3231caf062d'}, 'oper': 'CREATE', 'request-id': 'req-56fcd164-648a-4f93-9933-8cb43514b1d7', 'type': 'hardware', 'uuid': 'ed2aeca6-c7f4-4fe4-b687-e3231caf062d'} 06/02/2025 02:07:51.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:51.795 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-48t-6q'] not found in DB: Unknown id: hardware juniper-qfx5100-48t-6q 06/02/2025 02:07:51.796 7fad85451048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48t-6q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48t-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48t-6q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.797 7fad85451048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48t-6q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48t-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48t-6q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.820 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-48t-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100-48t-6q', 'fq_name': ['juniper-qfx5100-48t-6q'], 'id_perms': {'created': '2025-06-02T02:07:51.812805', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:51.812805', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11589048248928804201, 'uuid_mslong': 5814605915448626243}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '50b1a145-e333-4c43-a0d4-91fb22439d69'}, 'oper': 'CREATE', 'request-id': 'req-047f5cda-e49c-4a73-a58a-c378a3832991', 'type': 'hardware', 'uuid': '50b1a145-e333-4c43-a0d4-91fb22439d69'} 06/02/2025 02:07:51.919 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-24q-2p'] not found in DB: Unknown id: hardware juniper-qfx5100-24q-2p 06/02/2025 02:07:51.921 7fad853da978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-24q-2p url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-24q-2p"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-24q-2p"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.921 7fad853da978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-24q-2p url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-24q-2p"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-24q-2p"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:51.938 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-24q-2p'], 'obj_dict': {'display_name': 'juniper-qfx5100-24q-2p', 'fq_name': ['juniper-qfx5100-24q-2p'], 'id_perms': {'created': '2025-06-02T02:07:51.931707', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:51.931707', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9606270089042842590, 'uuid_mslong': 16426598806365423709}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'e3f70095-2144-485d-8550-53bff1dbd3de'}, 'oper': 'CREATE', 'request-id': 'req-33d861e7-cb7e-444c-b091-91829e99cd0b', 'type': 'hardware', 'uuid': 'e3f70095-2144-485d-8550-53bff1dbd3de'} 06/02/2025 02:07:52.031 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-24q-aa'] not found in DB: Unknown id: hardware juniper-qfx5100-24q-aa 06/02/2025 02:07:52.032 7fad85442048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-24q-aa url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-24q-aa"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-24q-aa"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.032 7fad85442048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-24q-aa url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-24q-aa"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-24q-aa"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.046 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-24q-aa'], 'obj_dict': {'display_name': 'juniper-qfx5100-24q-aa', 'fq_name': ['juniper-qfx5100-24q-aa'], 'id_perms': {'created': '2025-06-02T02:07:52.038780', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:52.038780', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10311929732089469913, 'uuid_mslong': 13569741776388309391}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'bc516840-0367-418f-8f1b-5574d5fb5bd9'}, 'oper': 'CREATE', 'request-id': 'req-6c15d4cf-8f37-476f-9f75-670e1ee5d19a', 'type': 'hardware', 'uuid': 'bc516840-0367-418f-8f1b-5574d5fb5bd9'} 06/02/2025 02:07:52.144 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100e-48s-6q'] not found in DB: Unknown id: hardware juniper-qfx5100e-48s-6q 06/02/2025 02:07:52.145 7fad856032e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-48s-6q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-48s-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-48s-6q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.145 7fad856032e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-48s-6q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-48s-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-48s-6q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.162 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100e-48s-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-48s-6q', 'fq_name': ['juniper-qfx5100e-48s-6q'], 'id_perms': {'created': '2025-06-02T02:07:52.155915', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:52.155915', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10606017436005673543, 'uuid_mslong': 5158742167758851033}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '479788ab-5d18-4bd9-9330-24aa3ab7aa47'}, 'oper': 'CREATE', 'request-id': 'req-ef4f6049-08b8-471f-b0d6-9a919b7300d2', 'type': 'hardware', 'uuid': '479788ab-5d18-4bd9-9330-24aa3ab7aa47'} 06/02/2025 02:07:52.256 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100e-96s-8q'] not found in DB: Unknown id: hardware juniper-qfx5100e-96s-8q 06/02/2025 02:07:52.257 7fad854aff60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-96s-8q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-96s-8q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-96s-8q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.257 7fad854aff60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-96s-8q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-96s-8q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-96s-8q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.280 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100e-96s-8q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-96s-8q', 'fq_name': ['juniper-qfx5100e-96s-8q'], 'id_perms': {'created': '2025-06-02T02:07:52.265198', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:52.265198', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11470704083301951444, 'uuid_mslong': 3534112549894180740}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '310bb0a3-bcb1-4f84-9f30-2096e0d5e7d4'}, 'oper': 'CREATE', 'request-id': 'req-453f14e6-41d7-4e5d-9301-40e74018acdc', 'type': 'hardware', 'uuid': '310bb0a3-bcb1-4f84-9f30-2096e0d5e7d4'} 06/02/2025 02:07:52.375 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100e-48t-6q'] not found in DB: Unknown id: hardware juniper-qfx5100e-48t-6q 06/02/2025 02:07:52.377 7fad8532e438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-48t-6q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-48t-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-48t-6q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.377 7fad8532e438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-48t-6q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-48t-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-48t-6q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.391 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100e-48t-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-48t-6q', 'fq_name': ['juniper-qfx5100e-48t-6q'], 'id_perms': {'created': '2025-06-02T02:07:52.383549', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:52.383549', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12143352368488656235, 'uuid_mslong': 11904844082944819620}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'a536809e-6e56-41a4-a885-daa4122a2d6b'}, 'oper': 'CREATE', 'request-id': 'req-dfdd6b15-bec3-4629-b1b9-20d706b09dfb', 'type': 'hardware', 'uuid': 'a536809e-6e56-41a4-a885-daa4122a2d6b'} 06/02/2025 02:07:52.487 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100e-24q-2p'] not found in DB: Unknown id: hardware juniper-qfx5100e-24q-2p 06/02/2025 02:07:52.488 7fad854cdcc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-24q-2p url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-24q-2p"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-24q-2p"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.488 7fad854cdcc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-24q-2p url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-24q-2p"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-24q-2p"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.501 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100e-24q-2p'], 'obj_dict': {'display_name': 'juniper-qfx5100e-24q-2p', 'fq_name': ['juniper-qfx5100e-24q-2p'], 'id_perms': {'created': '2025-06-02T02:07:52.493566', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:52.493566', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13088197267431204779, 'uuid_mslong': 3804440213201701535}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '34cc1637-9519-4a9f-b5a2-9e120b79a7ab'}, 'oper': 'CREATE', 'request-id': 'req-31325585-be55-4334-b649-19e445ab122a', 'type': 'hardware', 'uuid': '34cc1637-9519-4a9f-b5a2-9e120b79a7ab'} 06/02/2025 02:07:52.600 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5110-48s-4c'] not found in DB: Unknown id: hardware juniper-qfx5110-48s-4c 06/02/2025 02:07:52.601 7fad86204588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5110-48s-4c url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5110-48s-4c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5110-48s-4c"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.601 7fad86204588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5110-48s-4c url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5110-48s-4c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5110-48s-4c"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.622 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5110-48s-4c'], 'obj_dict': {'display_name': 'juniper-qfx5110-48s-4c', 'fq_name': ['juniper-qfx5110-48s-4c'], 'id_perms': {'created': '2025-06-02T02:07:52.607892', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:52.607892', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13016089130562080180, 'uuid_mslong': 580084810437053833}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '080ce00f-c9b3-4d89-b4a2-701a1ff9cdb4'}, 'oper': 'CREATE', 'request-id': 'req-cba1bdb1-2809-4ee1-afa5-70465db68d53', 'type': 'hardware', 'uuid': '080ce00f-c9b3-4d89-b4a2-701a1ff9cdb4'} 06/02/2025 02:07:52.713 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5110-32q'] not found in DB: Unknown id: hardware juniper-qfx5110-32q 06/02/2025 02:07:52.714 7fad852dc240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5110-32q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5110-32q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5110-32q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.714 7fad852dc240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5110-32q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5110-32q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5110-32q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.728 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5110-32q'], 'obj_dict': {'display_name': 'juniper-qfx5110-32q', 'fq_name': ['juniper-qfx5110-32q'], 'id_perms': {'created': '2025-06-02T02:07:52.720465', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:52.720465', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12744463535084144435, 'uuid_mslong': 10120361142717204233}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '8c72bed6-de53-4709-b0dd-6e0fe59c0733'}, 'oper': 'CREATE', 'request-id': 'req-c300b483-3f73-4743-b13a-38392700d07a', 'type': 'hardware', 'uuid': '8c72bed6-de53-4709-b0dd-6e0fe59c0733'} 06/02/2025 02:07:52.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:52.828 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5120-48y-8c'] not found in DB: Unknown id: hardware juniper-qfx5120-48y-8c 06/02/2025 02:07:52.830 7fad8532e4e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-48y-8c url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-48y-8c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-48y-8c"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.830 7fad8532e4e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-48y-8c url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-48y-8c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-48y-8c"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.844 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5120-48y-8c'], 'obj_dict': {'display_name': 'juniper-qfx5120-48y-8c', 'fq_name': ['juniper-qfx5120-48y-8c'], 'id_perms': {'created': '2025-06-02T02:07:52.837074', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:52.837074', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10766130934791049265, 'uuid_mslong': 3144821859687613800}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '2ba4a6d1-c490-4568-9568-fb0b35909031'}, 'oper': 'CREATE', 'request-id': 'req-74752326-743e-453e-8aab-588afd67512a', 'type': 'hardware', 'uuid': '2ba4a6d1-c490-4568-9568-fb0b35909031'} 06/02/2025 02:07:52.946 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5120-32c'] not found in DB: Unknown id: hardware juniper-qfx5120-32c 06/02/2025 02:07:52.947 7fad85557588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-32c url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-32c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-32c"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.947 7fad85557588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-32c url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-32c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-32c"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:52.962 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5120-32c'], 'obj_dict': {'display_name': 'juniper-qfx5120-32c', 'fq_name': ['juniper-qfx5120-32c'], 'id_perms': {'created': '2025-06-02T02:07:52.953521', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:52.953521', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9263398023765869699, 'uuid_mslong': 3913683616397871947}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '36503283-76a9-4b4b-808e-336c4b9ec483'}, 'oper': 'CREATE', 'request-id': 'req-1df8a727-1c37-45eb-a6aa-ea8c37082a7b', 'type': 'hardware', 'uuid': '36503283-76a9-4b4b-808e-336c4b9ec483'} 06/02/2025 02:07:53.063 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5120-48t-6c'] not found in DB: Unknown id: hardware juniper-qfx5120-48t-6c 06/02/2025 02:07:53.065 7fad85441b70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-48t-6c url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-48t-6c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-48t-6c"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:53.065 7fad85441b70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-48t-6c url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-48t-6c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-48t-6c"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:53.079 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5120-48t-6c'], 'obj_dict': {'display_name': 'juniper-qfx5120-48t-6c', 'fq_name': ['juniper-qfx5120-48t-6c'], 'id_perms': {'created': '2025-06-02T02:07:53.071236', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:53.071236', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9245239413957021457, 'uuid_mslong': 3222933081895879573}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '2cba288f-e942-4395-804d-b0437c594f11'}, 'oper': 'CREATE', 'request-id': 'req-8bac8575-8c56-4c49-bc42-816c76b5a7a2', 'type': 'hardware', 'uuid': '2cba288f-e942-4395-804d-b0437c594f11'} 06/02/2025 02:07:53.176 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5220-32cd'] not found in DB: Unknown id: hardware juniper-qfx5220-32cd 06/02/2025 02:07:53.177 7fad85602d68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5220-32cd url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5220-32cd"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5220-32cd"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:53.177 7fad85602d68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5220-32cd url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5220-32cd"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5220-32cd"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:53.196 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5220-32cd'], 'obj_dict': {'display_name': 'juniper-qfx5220-32cd', 'fq_name': ['juniper-qfx5220-32cd'], 'id_perms': {'created': '2025-06-02T02:07:53.183986', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:53.183986', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11632109835878272331, 'uuid_mslong': 12562436333174276335}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'ae56bd49-5050-40ef-a16d-8e4423da0d4b'}, 'oper': 'CREATE', 'request-id': 'req-e2f57e46-35d0-4b37-bde5-e8537672382e', 'type': 'hardware', 'uuid': 'ae56bd49-5050-40ef-a16d-8e4423da0d4b'} 06/02/2025 02:07:53.257 7fad85826588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:07:53.258 7fad85826588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:07:53.258 7fad85826588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.258 7fad85826588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:07:53.258 7fad85826588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.258 7fad85826588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.258 7fad85826588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 elements = { config_node_ip_address : "10.0.0.129"display_name : "cn-jenkins-deploy-platform-juju-os-542-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 4628382002360502182, "uuid_lslong": 11270785127697551173}, "enable": true, "created": "2025-06-02T02:07:49.634580", "last_modified": "2025-06-02T02:07:49.634580", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3b45d35b-de57-4285-b542-427e524b5c84"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "403b50e8-af82-47a6-9c69-df5bc42b0f45" } deleted = False >> 06/02/2025 02:07:53.258 7fad85826588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.258 7fad85826588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.259 7fad85826588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-management-ip elements = { display_name : "label=fabric-management-ip"fq_name : ["label=fabric-management-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 5744453937340761771, "uuid_lslong": 13635903918554517172}, "enable": true, "created": "2025-06-02T02:07:49.810913", "last_modified": "2025-06-02T02:07:49.810913", "description": null, "user_visible": true, "creator": null}name : "label=fabric-management-ip"perms2 : {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000000"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "1311cd87-1e77-4a0e-b031-c3e67ab4e6f1", "to": ["label"]}]tag_value : "fabric-management-ip"uuid : "4fb8666b-abca-46ab-bd3c-765e28cc8eb4" } deleted = False >> 06/02/2025 02:07:53.259 7fad85826588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.259 7fad85826588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.259 7fad85826588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-loopback-ip elements = { display_name : "label=fabric-loopback-ip"fq_name : ["label=fabric-loopback-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 13601467295424530467, "uuid_lslong": 9480527735110400151}, "enable": true, "created": "2025-06-02T02:07:49.954056", "last_modified": "2025-06-02T02:07:49.954056", "description": null, "user_visible": true, "creator": null}name : "label=fabric-loopback-ip"perms2 : {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000001"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "1311cd87-1e77-4a0e-b031-c3e67ab4e6f1", "to": ["label"]}]tag_value : "fabric-loopback-ip"uuid : "bcc21e71-07df-4823-8391-99bebe7e7897" } deleted = False >> 06/02/2025 02:07:53.259 7fad85826588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.259 7fad85826588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.259 7fad85826588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-overlay-loopback-ip elements = { display_name : "label=fabric-overlay-loopback-ip"fq_name : ["label=fabric-overlay-loopback-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 11018191656654750208, "uuid_lslong": 11649412711423729875}, "enable": true, "created": "2025-06-02T02:07:50.116242", "last_modified": "2025-06-02T02:07:50.116242", "description": null, "user_visible": true, "creator": null}name : "label=fabric-overlay-loopback-ip"perms2 : {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000002"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "1311cd87-1e77-4a0e-b031-c3e67ab4e6f1", "to": ["label"]}]tag_value : "fabric-overlay-loopback-ip"uuid : "98e87aef-5214-4200-a1ab-0723ca54e0d3" } deleted = False >> 06/02/2025 02:07:53.259 7fad85826588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.259 7fad85826588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.259 7fad85826588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-peer-ip elements = { display_name : "label=fabric-peer-ip"fq_name : ["label=fabric-peer-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 17602382620745744532, "uuid_lslong": 10736120122520308815}, "enable": true, "created": "2025-06-02T02:07:50.274101", "last_modified": "2025-06-02T02:07:50.274101", "description": null, "user_visible": true, "creator": null}name : "label=fabric-peer-ip"perms2 : {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000003"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "1311cd87-1e77-4a0e-b031-c3e67ab4e6f1", "to": ["label"]}]tag_value : "fabric-peer-ip"uuid : "f44839bb-6e0f-4094-94fe-5c5e78bf0c4f" } deleted = False >> 06/02/2025 02:07:53.259 7fad85826588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.259 7fad85826588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.259 7fad85826588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-pnf-servicechain-ip elements = { display_name : "label=fabric-pnf-servicechain-ip"fq_name : ["label=fabric-pnf-servicechain-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 17773949783267561330, "uuid_lslong": 11320097017832191850}, "enable": true, "created": "2025-06-02T02:07:50.424621", "last_modified": "2025-06-02T02:07:50.424621", "description": null, "user_visible": true, "creator": null}name : "label=fabric-pnf-servicechain-ip"perms2 : {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000004"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "1311cd87-1e77-4a0e-b031-c3e67ab4e6f1", "to": ["label"]}]tag_value : "fabric-pnf-servicechain-ip"uuid : "f6a9c128-4f4b-4f72-9d19-1042e2d8b76a" } deleted = False >> 06/02/2025 02:07:53.259 7fad85826588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.260 7fad85826588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.260 7fad85826588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-as-number elements = { display_name : "label=fabric-as-number"fq_name : ["label=fabric-as-number"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7168961639643041397, "uuid_lslong": 13154864950404860147}, "enable": true, "created": "2025-06-02T02:07:50.572758", "last_modified": "2025-06-02T02:07:50.572758", "description": null, "user_visible": true, "creator": null}name : "label=fabric-as-number"perms2 : {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000005"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "1311cd87-1e77-4a0e-b031-c3e67ab4e6f1", "to": ["label"]}]tag_value : "fabric-as-number"uuid : "637d44a0-e353-4e75-b68f-77f9951e48f3" } deleted = False >> 06/02/2025 02:07:53.260 7fad85826588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.260 7fad85826588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.260 7fad85826588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-ebgp-as-number elements = { display_name : "label=fabric-ebgp-as-number"fq_name : ["label=fabric-ebgp-as-number"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 13042016790813165269, "uuid_lslong": 12505833211747514519}, "enable": true, "created": "2025-06-02T02:07:50.720439", "last_modified": "2025-06-02T02:07:50.720439", "description": null, "user_visible": true, "creator": null}name : "label=fabric-ebgp-as-number"perms2 : {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000006"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "1311cd87-1e77-4a0e-b031-c3e67ab4e6f1", "to": ["label"]}]tag_value : "fabric-ebgp-as-number"uuid : "b4fe8d2b-f319-46d5-ad8d-a50c1e7e3897" } deleted = False >> 06/02/2025 02:07:53.260 7fad85826588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.260 7fad85826588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.260 7fad85826588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 elements = { config_database_node_ip_address : "10.0.0.129"display_name : "cn-jenkins-deploy-platform-juju-os-542-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 11456962236864940913, "uuid_lslong": 10170344549174564906}, "enable": true, "created": "2025-06-02T02:07:51.371476", "last_modified": "2025-06-02T02:07:51.371476", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3b45d35b-de57-4285-b542-427e524b5c84"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "9eff4e73-ed66-4b71-8d24-527b90e1582a" } deleted = False >> 06/02/2025 02:07:53.260 7fad85826588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:53.260 7fad85826588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:07:53.261 7fad85826588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:07:53.261 7fad85826588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:53.261 7fad85826588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:53.261 7fad85826588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:53.261 7fad85826588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:53.261 7fad85826588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:07:53.261 7fad85826588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:53.283 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5220-128c'] not found in DB: Unknown id: hardware juniper-qfx5220-128c 06/02/2025 02:07:53.284 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5220-128c url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5220-128c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5220-128c"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:53.301 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5220-128c'], 'obj_dict': {'display_name': 'juniper-qfx5220-128c', 'fq_name': ['juniper-qfx5220-128c'], 'id_perms': {'created': '2025-06-02T02:07:53.291123', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:53.291123', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9883298395142044872, 'uuid_mslong': 12420705018613157062}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'ac5f3568-1e59-4cc6-8928-8786c3a13cc8'}, 'oper': 'CREATE', 'request-id': 'req-54424d41-57ef-4a6c-8851-21e7f7ce424a', 'type': 'hardware', 'uuid': 'ac5f3568-1e59-4cc6-8928-8786c3a13cc8'} 06/02/2025 02:07:53.401 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5200-32c-32q'] not found in DB: Unknown id: hardware juniper-qfx5200-32c-32q 06/02/2025 02:07:53.402 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5200-32c-32q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5200-32c-32q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5200-32c-32q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:53.419 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5200-32c-32q'], 'obj_dict': {'display_name': 'juniper-qfx5200-32c-32q', 'fq_name': ['juniper-qfx5200-32c-32q'], 'id_perms': {'created': '2025-06-02T02:07:53.408057', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:53.408057', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11503144608533738823, 'uuid_mslong': 8094716537684315231}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '705635cd-aa27-4c5f-9fa3-61133f9a7547'}, 'oper': 'CREATE', 'request-id': 'req-576117bb-218d-42f6-bd0e-e62431f50889', 'type': 'hardware', 'uuid': '705635cd-aa27-4c5f-9fa3-61133f9a7547'} 06/02/2025 02:07:53.511 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5200-48y'] not found in DB: Unknown id: hardware juniper-qfx5200-48y 06/02/2025 02:07:53.512 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5200-48y url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5200-48y"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5200-48y"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:53.528 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5200-48y'], 'obj_dict': {'display_name': 'juniper-qfx5200-48y', 'fq_name': ['juniper-qfx5200-48y'], 'id_perms': {'created': '2025-06-02T02:07:53.519551', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:53.519551', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9759021300043378222, 'uuid_mslong': 2338091121685515132}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '2072917c-c88f-4b7c-876f-022ab88e6e2e'}, 'oper': 'CREATE', 'request-id': 'req-9d4238d6-3b7a-43ec-8dd4-c0b029a271ca', 'type': 'hardware', 'uuid': '2072917c-c88f-4b7c-876f-022ab88e6e2e'} 06/02/2025 02:07:53.645 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5210-64c'] not found in DB: Unknown id: hardware juniper-qfx5210-64c 06/02/2025 02:07:53.646 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5210-64c url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5210-64c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5210-64c"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:53.660 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5210-64c'], 'obj_dict': {'display_name': 'juniper-qfx5210-64c', 'fq_name': ['juniper-qfx5210-64c'], 'id_perms': {'created': '2025-06-02T02:07:53.652478', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:53.652478', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11394544838897010908, 'uuid_mslong': 3365092396911577377}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '2eb335b4-ba48-4921-9e21-8e28fbb788dc'}, 'oper': 'CREATE', 'request-id': 'req-b8a69503-ff43-4d36-a144-ca4a932c38cf', 'type': 'hardware', 'uuid': '2eb335b4-ba48-4921-9e21-8e28fbb788dc'} 06/02/2025 02:07:53.763 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx10002-72q'] not found in DB: Unknown id: hardware juniper-qfx10002-72q 06/02/2025 02:07:53.763 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10002-72q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10002-72q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10002-72q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:53.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:53.777 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx10002-72q'], 'obj_dict': {'display_name': 'juniper-qfx10002-72q', 'fq_name': ['juniper-qfx10002-72q'], 'id_perms': {'created': '2025-06-02T02:07:53.771230', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:53.771230', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9543355434414842605, 'uuid_mslong': 8914006445800572888}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '7bb4e9a2-4f7c-47d8-8470-cf34699722ed'}, 'oper': 'CREATE', 'request-id': 'req-71846712-3ada-4a06-97d8-270e5610f7fb', 'type': 'hardware', 'uuid': '7bb4e9a2-4f7c-47d8-8470-cf34699722ed'} 06/02/2025 02:07:53.875 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx10002-36q'] not found in DB: Unknown id: hardware juniper-qfx10002-36q 06/02/2025 02:07:53.876 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10002-36q url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10002-36q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10002-36q"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:53.891 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx10002-36q'], 'obj_dict': {'display_name': 'juniper-qfx10002-36q', 'fq_name': ['juniper-qfx10002-36q'], 'id_perms': {'created': '2025-06-02T02:07:53.883115', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:53.883115', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13656140380876303836, 'uuid_mslong': 2657836190601265237}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '24e287ee-fbf7-4055-bd84-5b52b4ffeddc'}, 'oper': 'CREATE', 'request-id': 'req-a3130eb0-16d0-4199-b4d1-0e4278804c38', 'type': 'hardware', 'uuid': '24e287ee-fbf7-4055-bd84-5b52b4ffeddc'} 06/02/2025 02:07:53.990 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx10002-60c'] not found in DB: Unknown id: hardware juniper-qfx10002-60c 06/02/2025 02:07:53.990 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10002-60c url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10002-60c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10002-60c"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:54.010 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx10002-60c'], 'obj_dict': {'display_name': 'juniper-qfx10002-60c', 'fq_name': ['juniper-qfx10002-60c'], 'id_perms': {'created': '2025-06-02T02:07:53.996756', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:53.996756', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12831742867615767470, 'uuid_mslong': 17626614211075657210}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'f49e503c-3404-4dfa-b213-82271163dbae'}, 'oper': 'CREATE', 'request-id': 'req-afa9cc9d-df42-469d-b61e-58a103e0c82f', 'type': 'hardware', 'uuid': 'f49e503c-3404-4dfa-b213-82271163dbae'} 06/02/2025 02:07:54.108 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx10016'] not found in DB: Unknown id: hardware juniper-qfx10016 06/02/2025 02:07:54.109 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10016 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10016"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10016"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:54.124 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx10016'], 'obj_dict': {'display_name': 'juniper-qfx10016', 'fq_name': ['juniper-qfx10016'], 'id_perms': {'created': '2025-06-02T02:07:54.115471', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:54.115471', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12502166855991684153, 'uuid_mslong': 6782308790926396509}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '5e1f99e9-402d-4c5d-ad80-9e84260bec39'}, 'oper': 'CREATE', 'request-id': 'req-d5cafe8d-8b9a-4abb-8417-6cd02f9885ae', 'type': 'hardware', 'uuid': '5e1f99e9-402d-4c5d-ad80-9e84260bec39'} 06/02/2025 02:07:54.221 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx10008'] not found in DB: Unknown id: hardware juniper-qfx10008 06/02/2025 02:07:54.222 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10008 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10008"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10008"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:54.241 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx10008'], 'obj_dict': {'display_name': 'juniper-qfx10008', 'fq_name': ['juniper-qfx10008'], 'id_perms': {'created': '2025-06-02T02:07:54.229427', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:54.229427', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10542737482063580461, 'uuid_mslong': 10120017056653069042}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '8c7185e5-16b3-4af2-924f-53e1d2988d2d'}, 'oper': 'CREATE', 'request-id': 'req-df923baa-de03-4ea5-aad0-edea01c9b6ef', 'type': 'hardware', 'uuid': '8c7185e5-16b3-4af2-924f-53e1d2988d2d'} 06/02/2025 02:07:54.340 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-vqfx-10000'] not found in DB: Unknown id: hardware juniper-vqfx-10000 06/02/2025 02:07:54.341 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-vqfx-10000 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-vqfx-10000"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-vqfx-10000"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:54.358 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-vqfx-10000'], 'obj_dict': {'display_name': 'juniper-vqfx-10000', 'fq_name': ['juniper-vqfx-10000'], 'id_perms': {'created': '2025-06-02T02:07:54.348053', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:54.348053', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9351828934712416174, 'uuid_mslong': 16197639674105712279}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'e0c99376-fed8-4e97-81c8-5ede35c0d7ae'}, 'oper': 'CREATE', 'request-id': 'req-d1fb9aa7-65c7-428e-891d-2c43c41a863d', 'type': 'hardware', 'uuid': 'e0c99376-fed8-4e97-81c8-5ede35c0d7ae'} 06/02/2025 02:07:54.459 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx80'] not found in DB: Unknown id: hardware juniper-mx80 06/02/2025 02:07:54.460 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx80 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx80"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx80"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:54.473 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx80'], 'obj_dict': {'display_name': 'juniper-mx80', 'fq_name': ['juniper-mx80'], 'id_perms': {'created': '2025-06-02T02:07:54.466298', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:54.466298', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12583439002791060745, 'uuid_mslong': 9865718419453332268}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '88ea12a1-b58b-4b2c-aea1-5b1a66282509'}, 'oper': 'CREATE', 'request-id': 'req-ae9a9e48-2ea8-4185-bf3a-a3dce9167f9f', 'type': 'hardware', 'uuid': '88ea12a1-b58b-4b2c-aea1-5b1a66282509'} 06/02/2025 02:07:54.571 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx80-48t'] not found in DB: Unknown id: hardware juniper-mx80-48t 06/02/2025 02:07:54.572 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx80-48t url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx80-48t"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx80-48t"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:54.587 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx80-48t'], 'obj_dict': {'display_name': 'juniper-mx80-48t', 'fq_name': ['juniper-mx80-48t'], 'id_perms': {'created': '2025-06-02T02:07:54.580613', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:54.580613', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13829536839862298970, 'uuid_mslong': 4250375391995314525}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '3afc5de6-49f1-415d-bfec-627bdc2ba95a'}, 'oper': 'CREATE', 'request-id': 'req-ac2f518c-d591-4d87-a2e2-c28c0ca53f05', 'type': 'hardware', 'uuid': '3afc5de6-49f1-415d-bfec-627bdc2ba95a'} 06/02/2025 02:07:54.686 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx204'] not found in DB: Unknown id: hardware juniper-mx204 06/02/2025 02:07:54.687 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx204 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx204"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx204"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:54.705 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx204'], 'obj_dict': {'display_name': 'juniper-mx204', 'fq_name': ['juniper-mx204'], 'id_perms': {'created': '2025-06-02T02:07:54.694222', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:54.694222', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10282768879566977899, 'uuid_mslong': 2089110599213728100}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '1cfe0305-7aa3-4164-8eb3-bbd0c607fb6b'}, 'oper': 'CREATE', 'request-id': 'req-68aa0e8a-1508-45e6-ada4-735829505cf3', 'type': 'hardware', 'uuid': '1cfe0305-7aa3-4164-8eb3-bbd0c607fb6b'} 06/02/2025 02:07:54.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:54.798 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx240'] not found in DB: Unknown id: hardware juniper-mx240 06/02/2025 02:07:54.798 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx240 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx240"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx240"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:54.815 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx240'], 'obj_dict': {'display_name': 'juniper-mx240', 'fq_name': ['juniper-mx240'], 'id_perms': {'created': '2025-06-02T02:07:54.806542', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:54.806542', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9349610964314639240, 'uuid_mslong': 1130166561304693079}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '0faf287f-e797-4957-81c0-7da2bc124b88'}, 'oper': 'CREATE', 'request-id': 'req-0c0299ac-9b3c-47e8-b367-a361df872cf5', 'type': 'hardware', 'uuid': '0faf287f-e797-4957-81c0-7da2bc124b88'} 06/02/2025 02:07:54.908 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx480'] not found in DB: Unknown id: hardware juniper-mx480 06/02/2025 02:07:54.909 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx480 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx480"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx480"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:54.926 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx480'], 'obj_dict': {'display_name': 'juniper-mx480', 'fq_name': ['juniper-mx480'], 'id_perms': {'created': '2025-06-02T02:07:54.914576', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:54.914576', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13316193635591368980, 'uuid_mslong': 2042535933565029717}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '1c588b9c-191d-4d55-b8cc-9f8f31bdb114'}, 'oper': 'CREATE', 'request-id': 'req-05fa82d0-9c5e-458b-9d7e-104526c68f88', 'type': 'hardware', 'uuid': '1c588b9c-191d-4d55-b8cc-9f8f31bdb114'} 06/02/2025 02:07:55.028 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx960'] not found in DB: Unknown id: hardware juniper-mx960 06/02/2025 02:07:55.029 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx960 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx960"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx960"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:55.043 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx960'], 'obj_dict': {'display_name': 'juniper-mx960', 'fq_name': ['juniper-mx960'], 'id_perms': {'created': '2025-06-02T02:07:55.035656', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:55.035656', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11146766746183165483, 'uuid_mslong': 7608805320425754328}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '6997e820-3114-4ed8-9ab1-454c2c62662b'}, 'oper': 'CREATE', 'request-id': 'req-23e05657-01c2-4929-827a-304763d893db', 'type': 'hardware', 'uuid': '6997e820-3114-4ed8-9ab1-454c2c62662b'} 06/02/2025 02:07:55.148 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx2008'] not found in DB: Unknown id: hardware juniper-mx2008 06/02/2025 02:07:55.148 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx2008 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx2008"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx2008"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:55.163 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx2008'], 'obj_dict': {'display_name': 'juniper-mx2008', 'fq_name': ['juniper-mx2008'], 'id_perms': {'created': '2025-06-02T02:07:55.155255', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:55.155255', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9829056188782102536, 'uuid_mslong': 2088881549201854411}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '1cfd32b3-9e0b-4fcb-8867-d286f1b64808'}, 'oper': 'CREATE', 'request-id': 'req-2220c8f7-8445-4e65-bb88-741ef714c83d', 'type': 'hardware', 'uuid': '1cfd32b3-9e0b-4fcb-8867-d286f1b64808'} 06/02/2025 02:07:55.259 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx2010'] not found in DB: Unknown id: hardware juniper-mx2010 06/02/2025 02:07:55.259 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx2010 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx2010"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx2010"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:55.274 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx2010'], 'obj_dict': {'display_name': 'juniper-mx2010', 'fq_name': ['juniper-mx2010'], 'id_perms': {'created': '2025-06-02T02:07:55.265718', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:55.265718', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12106634603960331921, 'uuid_mslong': 11130941446228296640}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '9a790c45-661c-43c0-a803-68075281ee91'}, 'oper': 'CREATE', 'request-id': 'req-48a58bb1-3787-42b8-9a62-010d1f4bbe00', 'type': 'hardware', 'uuid': '9a790c45-661c-43c0-a803-68075281ee91'} 06/02/2025 02:07:55.373 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx2020'] not found in DB: Unknown id: hardware juniper-mx2020 06/02/2025 02:07:55.373 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx2020 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx2020"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx2020"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:55.389 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx2020'], 'obj_dict': {'display_name': 'juniper-mx2020', 'fq_name': ['juniper-mx2020'], 'id_perms': {'created': '2025-06-02T02:07:55.381240', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:55.381240', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9400102740974025043, 'uuid_mslong': 1021962183242498247}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '0e2ebd30-ea0d-40c7-8273-dfa397eeb953'}, 'oper': 'CREATE', 'request-id': 'req-49a4e4d2-9afb-4529-8bc8-c59270b530bf', 'type': 'hardware', 'uuid': '0e2ebd30-ea0d-40c7-8273-dfa397eeb953'} 06/02/2025 02:07:55.484 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx10003'] not found in DB: Unknown id: hardware juniper-mx10003 06/02/2025 02:07:55.484 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx10003 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx10003"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx10003"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:55.497 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx10003'], 'obj_dict': {'display_name': 'juniper-mx10003', 'fq_name': ['juniper-mx10003'], 'id_perms': {'created': '2025-06-02T02:07:55.490187', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:55.490187', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12907202618263484594, 'uuid_mslong': 10930384741755145387}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '97b08702-ceaa-4cab-b31f-9865619638b2'}, 'oper': 'CREATE', 'request-id': 'req-cada9d96-76e9-4af2-9ca6-940ccd1d5b49', 'type': 'hardware', 'uuid': '97b08702-ceaa-4cab-b31f-9865619638b2'} 06/02/2025 02:07:55.591 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-jnp10008'] not found in DB: Unknown id: hardware juniper-jnp10008 06/02/2025 02:07:55.591 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-jnp10008 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-jnp10008"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-jnp10008"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:55.611 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-jnp10008'], 'obj_dict': {'display_name': 'juniper-jnp10008', 'fq_name': ['juniper-jnp10008'], 'id_perms': {'created': '2025-06-02T02:07:55.598724', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:55.598724', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11196197524324909362, 'uuid_mslong': 7789317186794639173}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '6c1936b6-39bd-4f45-9b60-e254107e8132'}, 'oper': 'CREATE', 'request-id': 'req-d1f3c66c-36af-40c0-b3a5-0cc030a7968f', 'type': 'hardware', 'uuid': '6c1936b6-39bd-4f45-9b60-e254107e8132'} 06/02/2025 02:07:55.694 7fad8534f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_objects in resource global-vrouter-config: 'security_logging_objects' 06/02/2025 02:07:55.694 7fad8534f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-vrouter-config: 'tag_refs' 06/02/2025 02:07:55.694 7fad8534f588 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field application_policy_set_back_refs in resource global-vrouter-config: 'application_policy_set_back_refs' 06/02/2025 02:07:55.703 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-jnp10016'] not found in DB: Unknown id: hardware juniper-jnp10016 06/02/2025 02:07:55.704 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-jnp10016 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-jnp10016"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-jnp10016"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:55.719 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-jnp10016'], 'obj_dict': {'display_name': 'juniper-jnp10016', 'fq_name': ['juniper-jnp10016'], 'id_perms': {'created': '2025-06-02T02:07:55.710290', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:55.710290', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10064928841213450735, 'uuid_mslong': 14990270033608068690}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'd008232c-7864-4e52-8bad-cf746e1c99ef'}, 'oper': 'CREATE', 'request-id': 'req-b882dd19-df57-4ca9-9d63-1a83d99e42ab', 'type': 'hardware', 'uuid': 'd008232c-7864-4e52-8bad-cf746e1c99ef'} 06/02/2025 02:07:55.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:55.800 7fad8534f588 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 26ae01a2-4559-44e7-8a63-b8afe58aeb73 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = https://10.0.0.129:8082/global-vrouter-config/26ae01a2-4559-44e7-8a63-b8afe58aeb73 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.129 body = {"global-vrouter-config": {"uuid": "26ae01a2-4559-44e7-8a63-b8afe58aeb73", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["127.0.0.1"]}]}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:55.814 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-vmx'] not found in DB: Unknown id: hardware juniper-vmx 06/02/2025 02:07:55.815 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-vmx url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-vmx"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-vmx"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:55.820 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-5406471f-7baa-428c-bd1d-0007ea4c3138', 'type': 'global_vrouter_config', 'uuid': '26ae01a2-4559-44e7-8a63-b8afe58aeb73'} 06/02/2025 02:07:55.851 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-vmx'], 'obj_dict': {'display_name': 'juniper-vmx', 'fq_name': ['juniper-vmx'], 'id_perms': {'created': '2025-06-02T02:07:55.833648', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:55.833648', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10881914736879015762, 'uuid_mslong': 2163012980163560990}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '1e0490d8-6735-461e-9704-53cc5fc31752'}, 'oper': 'CREATE', 'request-id': 'req-88dbb45b-5cca-491a-ae70-9bc7bd273269', 'type': 'hardware', 'uuid': '1e0490d8-6735-461e-9704-53cc5fc31752'} 06/02/2025 02:07:55.952 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx5400'] not found in DB: Unknown id: hardware juniper-srx5400 06/02/2025 02:07:55.953 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx5400 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx5400"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx5400"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:55.968 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx5400'], 'obj_dict': {'display_name': 'juniper-srx5400', 'fq_name': ['juniper-srx5400'], 'id_perms': {'created': '2025-06-02T02:07:55.959011', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:55.959011', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9918672979487145651, 'uuid_mslong': 2718071885499811774}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '25b887fa-9931-47be-89a6-34860198beb3'}, 'oper': 'CREATE', 'request-id': 'req-ec3b07de-c5bd-4d68-9c4d-0dc87931ebf4', 'type': 'hardware', 'uuid': '25b887fa-9931-47be-89a6-34860198beb3'} 06/02/2025 02:07:56.064 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx5600'] not found in DB: Unknown id: hardware juniper-srx5600 06/02/2025 02:07:56.065 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx5600 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx5600"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx5600"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:56.086 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx5600'], 'obj_dict': {'display_name': 'juniper-srx5600', 'fq_name': ['juniper-srx5600'], 'id_perms': {'created': '2025-06-02T02:07:56.072211', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:56.072211', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11814222239414836928, 'uuid_mslong': 3642761029171300810}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '328dafdb-1964-49ca-a3f4-8c8845d75ec0'}, 'oper': 'CREATE', 'request-id': 'req-1853ec94-2a67-429f-b962-c0e64dd8e413', 'type': 'hardware', 'uuid': '328dafdb-1964-49ca-a3f4-8c8845d75ec0'} 06/02/2025 02:07:56.185 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx4600'] not found in DB: Unknown id: hardware juniper-srx4600 06/02/2025 02:07:56.186 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx4600 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx4600"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx4600"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:56.203 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx4600'], 'obj_dict': {'display_name': 'juniper-srx4600', 'fq_name': ['juniper-srx4600'], 'id_perms': {'created': '2025-06-02T02:07:56.193339', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:56.193339', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9955107760770297994, 'uuid_mslong': 2191662715533281227}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '1e6a59a0-bad4-47cb-8a27-a5c39572b08a'}, 'oper': 'CREATE', 'request-id': 'req-ee51d56d-3262-4b91-bce6-123a1c809329', 'type': 'hardware', 'uuid': '1e6a59a0-bad4-47cb-8a27-a5c39572b08a'} 06/02/2025 02:07:56.300 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx4100'] not found in DB: Unknown id: hardware juniper-srx4100 06/02/2025 02:07:56.300 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx4100 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx4100"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx4100"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:56.322 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx4100'], 'obj_dict': {'display_name': 'juniper-srx4100', 'fq_name': ['juniper-srx4100'], 'id_perms': {'created': '2025-06-02T02:07:56.308288', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:56.308288', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12065670365100599704, 'uuid_mslong': 6972722439159173016}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '60c4161d-877a-4f98-a771-df4538c76998'}, 'oper': 'CREATE', 'request-id': 'req-cd0d2014-8499-4602-9eac-60d8cb5ed871', 'type': 'hardware', 'uuid': '60c4161d-877a-4f98-a771-df4538c76998'} 06/02/2025 02:07:56.412 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx1500'] not found in DB: Unknown id: hardware juniper-srx1500 06/02/2025 02:07:56.413 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx1500 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx1500"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx1500"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:56.432 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx1500'], 'obj_dict': {'display_name': 'juniper-srx1500', 'fq_name': ['juniper-srx1500'], 'id_perms': {'created': '2025-06-02T02:07:56.422034', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:56.422034', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11408669230427201880, 'uuid_mslong': 7059430089914011043}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '61f82243-aa07-4da3-9e53-bc38278ae158'}, 'oper': 'CREATE', 'request-id': 'req-a6fb91c0-3944-48b3-a758-376a54c133ae', 'type': 'hardware', 'uuid': '61f82243-aa07-4da3-9e53-bc38278ae158'} 06/02/2025 02:07:56.527 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx240h-poe'] not found in DB: Unknown id: hardware juniper-srx240h-poe 06/02/2025 02:07:56.527 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx240h-poe url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx240h-poe"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx240h-poe"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:56.546 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx240h-poe'], 'obj_dict': {'display_name': 'juniper-srx240h-poe', 'fq_name': ['juniper-srx240h-poe'], 'id_perms': {'created': '2025-06-02T02:07:56.534440', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:56.534440', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13717195723585251128, 'uuid_mslong': 14869090971928579408}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'ce599f75-8ac5-4d50-be5d-44d572ce6738'}, 'oper': 'CREATE', 'request-id': 'req-29be32e8-e496-4286-b82a-00662cc95edb', 'type': 'hardware', 'uuid': 'ce599f75-8ac5-4d50-be5d-44d572ce6738'} 06/02/2025 02:07:56.647 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx5800'] not found in DB: Unknown id: hardware juniper-srx5800 06/02/2025 02:07:56.647 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx5800 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx5800"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx5800"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:56.662 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-conf-elements-inconsistency'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-conf-elements-inconsistency 06/02/2025 02:07:56.671 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx5800'], 'obj_dict': {'display_name': 'juniper-srx5800', 'fq_name': ['juniper-srx5800'], 'id_perms': {'created': '2025-06-02T02:07:56.655824', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:56.655824', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9900717509704767526, 'uuid_mslong': 14926062786806302211}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'cf240705-dec4-4603-8966-6a1e6b715826'}, 'oper': 'CREATE', 'request-id': 'req-482c17cf-ce43-4fc8-ba52-2c474c0f3dfb', 'type': 'hardware', 'uuid': 'cf240705-dec4-4603-8966-6a1e6b715826'} 06/02/2025 02:07:56.675 7fad85442978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig has a list of elements - it should be a dict. Controllers have inconsistency in their data.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-elements-inconsistency"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:56.720 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements', 'operand2': {'json_value': '1'}, 'operation': 'size=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-elements-inconsistency', 'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'id_perms': {'created': '2025-06-02T02:07:56.713154', 'creator': None, 'description': 'ContrailConfig has a list of ' 'elements - it should be a dict. ' 'Controllers have inconsistency in ' 'their data.', 'enable': True, 'last_modified': '2025-06-02T02:07:56.713154', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11192669765700851651, 'uuid_mslong': 16953958975131568455}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'eb488fdc-a943-4947-9b54-59d9c0da97c3', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-41b203a8-15ea-4c51-9bdd-65c212a5c973', 'type': 'alarm', 'uuid': 'eb488fdc-a943-4947-9b54-59d9c0da97c3'} 06/02/2025 02:07:56.726 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-address-mismatch-compute'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-address-mismatch-compute 06/02/2025 02:07:56.732 7fad85442978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Compute Node IP Address mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-address-mismatch-compute"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:56.763 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx4200'] not found in DB: Unknown id: hardware juniper-srx4200 06/02/2025 02:07:56.764 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx4200 url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx4200"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx4200"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:56.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:56.777 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_ip_address', 'operand2': {'uve_attribute': 'VrouterAgent.control_ip'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-compute', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'id_perms': {'created': '2025-06-02T02:07:56.755151', 'creator': None, 'description': 'Compute Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-06-02T02:07:56.755151', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9811005472190789214, 'uuid_mslong': 4179785920403295021}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3a019526-2ed1-4b2d-8827-b17efb58765e', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-ac07a7c8-95a8-425e-a609-9e4693cc48f1', 'type': 'alarm', 'uuid': '3a019526-2ed1-4b2d-8827-b17efb58765e'} 06/02/2025 02:07:56.790 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx4200'], 'obj_dict': {'display_name': 'juniper-srx4200', 'fq_name': ['juniper-srx4200'], 'id_perms': {'created': '2025-06-02T02:07:56.771622', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:56.771622', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11766418178997542846, 'uuid_mslong': 5485445158952258338}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '4c20374f-163c-4b22-a34a-b6fe1dd8dfbe'}, 'oper': 'CREATE', 'request-id': 'req-cd419b6b-aba5-4695-9d59-17d832150d61', 'type': 'hardware', 'uuid': '4c20374f-163c-4b22-a34a-b6fe1dd8dfbe'} 06/02/2025 02:07:56.811 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-address-mismatch-control'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-address-mismatch-control 06/02/2025 02:07:56.816 7fad85442978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Control Node IP Address mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-address-mismatch-control"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:56.851 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.bgp_router_parameters.address', 'operand2': {'uve_attribute': 'BgpRouterState.bgp_router_ip_list'}, 'operation': 'not ' 'in'}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-control', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'id_perms': {'created': '2025-06-02T02:07:56.837172', 'creator': None, 'description': 'Control Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-06-02T02:07:56.837172', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11986950132903284464, 'uuid_mslong': 3626849425279174666}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '32552856-1f98-480a-a65a-33a2e4058ef0', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-84efa85b-2211-4442-b6d2-17867fde8d7a', 'type': 'alarm', 'uuid': '32552856-1f98-480a-a65a-33a2e4058ef0'} 06/02/2025 02:07:56.891 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-vsrx'] not found in DB: Unknown id: hardware juniper-vsrx 06/02/2025 02:07:56.892 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-vsrx url = https://10.0.0.129:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"hardware": {"uuid": null, "fq_name": ["juniper-vsrx"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-vsrx"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:56.893 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-bgp-connectivity'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-bgp-connectivity 06/02/2025 02:07:56.900 7fad85442978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "BGP peer mismatch. Not enough BGP peers are up.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-bgp-connectivity"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:56.995 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-vsrx'], 'obj_dict': {'display_name': 'juniper-vsrx', 'fq_name': ['juniper-vsrx'], 'id_perms': {'created': '2025-06-02T02:07:56.989539', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:56.989539', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10946663026360997856, 'uuid_mslong': 2289047744755486060}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': '1fc454cb-c40f-4d6c-97ea-5c064a2657e0'}, 'oper': 'CREATE', 'request-id': 'req-2c88e1fe-b77a-4d8b-8514-6a3f15a2c547', 'type': 'hardware', 'uuid': '1fc454cb-c40f-4d6c-97ea-5c064a2657e0'} 06/02/2025 02:07:57.013 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_bgp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-bgp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'id_perms': {'created': '2025-06-02T02:07:57.002904', 'creator': None, 'description': 'BGP peer mismatch. Not enough BGP ' 'peers are up.', 'enable': True, 'last_modified': '2025-06-02T02:07:57.002904', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10685469063175383620, 'uuid_mslong': 17481089444430565035}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f2994e3b-1e1d-4eab-944a-697fb8feaa44', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-5e8001ea-2d03-4234-8fe8-bc52cb706966', 'type': 'alarm', 'uuid': 'f2994e3b-1e1d-4eab-944a-697fb8feaa44'} 06/02/2025 02:07:57.060 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-conf-incorrect'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-conf-incorrect 06/02/2025 02:07:57.068 7fad85442978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-incorrect"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.099 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-incorrect', 'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'id_perms': {'created': '2025-06-02T02:07:57.084680', 'creator': None, 'description': 'ContrailConfig missing or ' 'incorrect. Configuration pushed to ' 'Ifmap as ContrailConfig is ' 'missing/incorrect.', 'enable': True, 'last_modified': '2025-06-02T02:07:57.084680', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12674825803309052732, 'uuid_mslong': 542571333500423538}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '078799c0-ce9a-4d72-afe6-06e9fc30f33c', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-55e0650e-93a4-4179-a421-aa9ec7349fae', 'type': 'alarm', 'uuid': '078799c0-ce9a-4d72-afe6-06e9fc30f33c'} 06/02/2025 02:07:57.108 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'underlay-ip-clos'] not found in DB: Unknown id: feature default-global-system-config:underlay-ip-clos 06/02/2025 02:07:57.116 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:underlay-ip-clos url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "underlay-ip-clos"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "underlay-ip-clos"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.140 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-disk-usage-high'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-disk-usage-high 06/02/2025 02:07:57.142 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'underlay-ip-clos'], 'obj_dict': {'display_name': 'underlay-ip-clos', 'fq_name': ['default-global-system-config', 'underlay-ip-clos'], 'id_perms': {'created': '2025-06-02T02:07:57.130815', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:57.130815', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9946029328571052218, 'uuid_mslong': 3580215825858252255}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '31af7b53-2783-4ddf-8a07-64fa5f1830ba'}, 'oper': 'CREATE', 'request-id': 'req-b8367722-56ab-453a-af06-3c8c61924ca7', 'type': 'feature', 'uuid': '31af7b53-2783-4ddf-8a07-64fa5f1830ba'} 06/02/2025 02:07:57.148 7fad85442978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Disk usage crosses high threshold limit.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-disk-usage-high"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.179 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '[70, ' '90]'}, 'operation': 'range', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-disk-usage-high', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'id_perms': {'created': '2025-06-02T02:07:57.162956', 'creator': None, 'description': 'Disk usage crosses high threshold ' 'limit.', 'enable': True, 'last_modified': '2025-06-02T02:07:57.162956', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11234748896340866491, 'uuid_mslong': 3330587087813823720}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2e389f4f-66a5-4ce8-9be9-d898d31bf5bb', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-f276b75f-ead8-4bc1-b538-a40db4d7373a', 'type': 'alarm', 'uuid': '2e389f4f-66a5-4ce8-9be9-d898d31bf5bb'} 06/02/2025 02:07:57.219 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-disk-usage-critical'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-disk-usage-critical 06/02/2025 02:07:57.226 7fad85442978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Disk usage crosses critical threshold limit.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-disk-usage-critical"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.252 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '90'}, 'operation': '>', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-disk-usage-critical', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'id_perms': {'created': '2025-06-02T02:07:57.239077', 'creator': None, 'description': 'Disk usage crosses critical ' 'threshold limit.', 'enable': True, 'last_modified': '2025-06-02T02:07:57.239077', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12473009659247715457, 'uuid_mslong': 2834116252530592535}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2754cdb7-443f-4b17-ad19-08334379e481', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-56eb0b95-73a5-4d87-bf15-a31779df5e9a', 'type': 'alarm', 'uuid': '2754cdb7-443f-4b17-ad19-08334379e481'} 06/02/2025 02:07:57.257 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'overlay-bgp'] not found in DB: Unknown id: feature default-global-system-config:overlay-bgp 06/02/2025 02:07:57.258 7fad86c7b198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:57.266 7fad852e1a20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:overlay-bgp url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "overlay-bgp"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "overlay-bgp"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.266 7fad852e1a20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:overlay-bgp url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "overlay-bgp"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "overlay-bgp"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.294 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-node-status'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-node-status 06/02/2025 02:07:57.302 7fad85355048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Node Failure. NodeStatus UVE not present.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-node-status"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.302 7fad85355048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Node Failure. NodeStatus UVE not present.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-node-status"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.304 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'overlay-bgp'], 'obj_dict': {'display_name': 'overlay-bgp', 'fq_name': ['default-global-system-config', 'overlay-bgp'], 'id_perms': {'created': '2025-06-02T02:07:57.284095', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:57.284095', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9762000569281602403, 'uuid_mslong': 15865593536038977763}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dc2de942-f256-40e3-8779-97cbe530e363'}, 'oper': 'CREATE', 'request-id': 'req-71c9dd4b-a5f1-4fb3-a0a7-0f0102b113f4', 'type': 'feature', 'uuid': 'dc2de942-f256-40e3-8779-97cbe530e363'} 06/02/2025 02:07:57.352 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-node-status', 'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'id_perms': {'created': '2025-06-02T02:07:57.336645', 'creator': None, 'description': 'Node Failure. NodeStatus UVE not ' 'present.', 'enable': True, 'last_modified': '2025-06-02T02:07:57.336645', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13224358028118825426, 'uuid_mslong': 14962769592190517331}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cfa66faa-fe88-4053-b786-5b8f989b99d2', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-4db5d940-5cd4-45dd-866c-6003be332da4', 'type': 'alarm', 'uuid': 'cfa66faa-fe88-4053-b786-5b8f989b99d2'} 06/02/2025 02:07:57.384 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'l2-gateway'] not found in DB: Unknown id: feature default-global-system-config:l2-gateway 06/02/2025 02:07:57.391 7fad85836240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:l2-gateway url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "l2-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "l2-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.392 7fad85836240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:l2-gateway url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "l2-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "l2-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.393 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-partial-sysinfo'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-partial-sysinfo 06/02/2025 02:07:57.404 7fad85543978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "System Info Incomplete.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-partial-sysinfo"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.404 7fad85543978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "System Info Incomplete.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-partial-sysinfo"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.433 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'l2-gateway'], 'obj_dict': {'display_name': 'l2-gateway', 'fq_name': ['default-global-system-config', 'l2-gateway'], 'id_perms': {'created': '2025-06-02T02:07:57.420239', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:57.420239', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11413217690365365053, 'uuid_mslong': 3589200312653072850}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '31cf66aa-ff68-49d2-9e63-e505026e8b3d'}, 'oper': 'CREATE', 'request-id': 'req-e7c72f22-1097-4889-a041-2dd8044ca88e', 'type': 'feature', 'uuid': '31cf66aa-ff68-49d2-9e63-e505026e8b3d'} 06/02/2025 02:07:57.447 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.build_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-partial-sysinfo', 'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'id_perms': {'created': '2025-06-02T02:07:57.426474', 'creator': None, 'description': 'System Info Incomplete.', 'enable': True, 'last_modified': '2025-06-02T02:07:57.426474', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11215324009587217632, 'uuid_mslong': 8809818601867592325}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7a42c357-8bf2-4285-9ba4-d5c3f05b14e0', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-babb88e9-8dff-47c9-b47a-af575aaf87ac', 'type': 'alarm', 'uuid': '7a42c357-8bf2-4285-9ba4-d5c3f05b14e0'} 06/02/2025 02:07:57.484 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-process-connectivity'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-process-connectivity 06/02/2025 02:07:57.490 7fad85602f60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process(es) reporting as non-functional.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-connectivity"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.491 7fad85602f60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process(es) reporting as non-functional.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-connectivity"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.517 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_status', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_status.state', 'operand2': {'json_value': '"Functional"'}, 'operation': '!=', 'variables': ['NodeStatus.process_status.module_id', 'NodeStatus.process_status.instance_id']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'id_perms': {'created': '2025-06-02T02:07:57.506302', 'creator': None, 'description': 'Process(es) reporting as ' 'non-functional.', 'enable': True, 'last_modified': '2025-06-02T02:07:57.506302', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11079004770695495070, 'uuid_mslong': 10273376941937542816}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8e925de5-e3e0-46a0-99c0-8823ce29bd9e', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-a2c71387-4b63-4edf-be4c-d642dc021102', 'type': 'alarm', 'uuid': '8e925de5-e3e0-46a0-99c0-8823ce29bd9e'} 06/02/2025 02:07:57.537 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'l3-gateway'] not found in DB: Unknown id: feature default-global-system-config:l3-gateway 06/02/2025 02:07:57.543 7fad851feac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:l3-gateway url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "l3-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "l3-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.543 7fad851feac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:l3-gateway url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "l3-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "l3-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.563 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-process-status'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-process-status 06/02/2025 02:07:57.568 7fad8582db70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process Failure.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-status"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.568 7fad8582db70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process Failure.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-status"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.569 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'l3-gateway'], 'obj_dict': {'display_name': 'l3-gateway', 'fq_name': ['default-global-system-config', 'l3-gateway'], 'id_perms': {'created': '2025-06-02T02:07:57.554200', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:57.554200', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10907299331424992664, 'uuid_mslong': 13704649462547235733}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'be30b213-6a60-4395-975e-82f3dc713d98'}, 'oper': 'CREATE', 'request-id': 'req-8eee65b7-e1df-4b5e-a4e2-823186f7733d', 'type': 'feature', 'uuid': 'be30b213-6a60-4395-975e-82f3dc713d98'} 06/02/2025 02:07:57.598 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_info.process_state', 'operand2': {'json_value': '"PROCESS_STATE_RUNNING"'}, 'operation': '!=', 'variables': ['NodeStatus.process_info.process_name']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-status', 'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'id_perms': {'created': '2025-06-02T02:07:57.580696', 'creator': None, 'description': 'Process Failure.', 'enable': True, 'last_modified': '2025-06-02T02:07:57.580696', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10906548044840871372, 'uuid_mslong': 4287001562779304699}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3b7e7d35-3501-42fb-975b-d7a95278a5cc', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-dee54581-e31a-4b8e-8dda-90dc855cbbeb', 'type': 'alarm', 'uuid': '3b7e7d35-3501-42fb-975b-d7a95278a5cc'} 06/02/2025 02:07:57.640 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-prouter-connectivity'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-prouter-connectivity 06/02/2025 02:07:57.649 7fad8520fcc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tor agent does not exist we look for non-empty value for connected_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-connectivity"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.649 7fad8520fcc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tor agent does not exist we look for non-empty value for connected_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-connectivity"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.669 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'vn-interconnect'] not found in DB: Unknown id: feature default-global-system-config:vn-interconnect 06/02/2025 02:07:57.675 7fad851fed68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:vn-interconnect url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "vn-interconnect"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vn-interconnect"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.676 7fad851fed68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:vn-interconnect url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "vn-interconnect"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vn-interconnect"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.679 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.connected_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'id_perms': {'created': '2025-06-02T02:07:57.668695', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tor agent does not exist we look ' 'for non-empty value for ' 'connected_agent_list', 'enable': True, 'last_modified': '2025-06-02T02:07:57.668695', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13494634041529976179, 'uuid_mslong': 1285371852788615966}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '11d68ee3-d1c0-4b1e-bb46-9229c349c573', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-01036157-9ed9-4655-ade7-dcded8fcd8f3', 'type': 'alarm', 'uuid': '11d68ee3-d1c0-4b1e-bb46-9229c349c573'} 06/02/2025 02:07:57.706 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'vn-interconnect'], 'obj_dict': {'display_name': 'vn-interconnect', 'fq_name': ['default-global-system-config', 'vn-interconnect'], 'id_perms': {'created': '2025-06-02T02:07:57.692039', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:57.692039', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11289099333950878127, 'uuid_mslong': 3082564483433384266}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2ac77810-c848-494a-9caa-f008323db1af'}, 'oper': 'CREATE', 'request-id': 'req-6448c13b-80e6-4649-8ead-0c54f1c13dac', 'type': 'feature', 'uuid': '2ac77810-c848-494a-9caa-f008323db1af'} 06/02/2025 02:07:57.726 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-prouter-tsn-connectivity 06/02/2025 02:07:57.733 7fad853baac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tsn agent does not exist we look for non-empty value for tsn_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-tsn-connectivity"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.733 7fad853baac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tsn agent does not exist we look for non-empty value for tsn_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-tsn-connectivity"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:57.804 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'dc-gateway'] not found in DB: Unknown id: feature default-global-system-config:dc-gateway 06/02/2025 02:07:57.811 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '!='}]}, {'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-tsn-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'id_perms': {'created': '2025-06-02T02:07:57.750108', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tsn agent does not exist we look ' 'for non-empty value for ' 'tsn_agent_list', 'enable': True, 'last_modified': '2025-06-02T02:07:57.750108', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9451778787302229204, 'uuid_mslong': 15172366740038239153}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd28f1329-d5ee-43b1-832b-76bab8b8c4d4', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-2b37e8b6-2db0-4d44-bb72-c7c934c87aa7', 'type': 'alarm', 'uuid': 'd28f1329-d5ee-43b1-832b-76bab8b8c4d4'} 06/02/2025 02:07:57.816 7fad851f2390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:dc-gateway url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.816 7fad851f2390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:dc-gateway url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.839 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway'], 'obj_dict': {'display_name': 'dc-gateway', 'fq_name': ['default-global-system-config', 'dc-gateway'], 'id_perms': {'created': '2025-06-02T02:07:57.829725', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:57.829725', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11523670699120727966, 'uuid_mslong': 8969029056167627313}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7c786468-1907-4a31-9fec-4d7221ab179e'}, 'oper': 'CREATE', 'request-id': 'req-41632083-79bd-43b7-9803-af33621df087', 'type': 'feature', 'uuid': '7c786468-1907-4a31-9fec-4d7221ab179e'} 06/02/2025 02:07:57.852 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-storage-cluster-state'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-storage-cluster-state 06/02/2025 02:07:57.857 7fad87738630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Storage Cluster warning/errors.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-storage-cluster-state"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.857 7fad87738630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Storage Cluster warning/errors.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-storage-cluster-state"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.888 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'StorageCluster.info_stats.status', 'operand2': {'json_value': '0'}, 'operation': '!=', 'variables': ['StorageCluster.info_stats.health_summary']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-storage-cluster-state', 'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'id_perms': {'created': '2025-06-02T02:07:57.871956', 'creator': None, 'description': 'Storage Cluster warning/errors.', 'enable': True, 'last_modified': '2025-06-02T02:07:57.871956', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13352592325334538187, 'uuid_mslong': 17914047676552202973}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f89b7b72-fa4e-4add-b94d-eff98e2c17cb', 'uve_keys': {'uve_key': ['storage-cluster']}}, 'oper': 'CREATE', 'request-id': 'req-0acb19f3-dae0-4dd9-831b-1ecf33bd1bf1', 'type': 'alarm', 'uuid': 'f89b7b72-fa4e-4add-b94d-eff98e2c17cb'} 06/02/2025 02:07:57.931 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-vrouter-interface'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-vrouter-interface 06/02/2025 02:07:57.932 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'assisted-replicator'] not found in DB: Unknown id: feature default-global-system-config:assisted-replicator 06/02/2025 02:07:57.936 7fad8561e198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Vrouter interface(s) down.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-interface"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.936 7fad8561e198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Vrouter interface(s) down.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-interface"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.937 7fad85602ac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:assisted-replicator url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "assisted-replicator"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "assisted-replicator"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.938 7fad85602ac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:assisted-replicator url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "assisted-replicator"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "assisted-replicator"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:57.959 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.down_interface_count', 'operand2': {'json_value': '1'}, 'operation': '>=', 'variables': ['VrouterAgent.error_intf_list', 'VrouterAgent.no_config_intf_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-interface', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'id_perms': {'created': '2025-06-02T02:07:57.951141', 'creator': None, 'description': 'Vrouter interface(s) down.', 'enable': True, 'last_modified': '2025-06-02T02:07:57.951141', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9523896605499033734, 'uuid_mslong': 11568027698665704500}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a089e3e6-e2d9-4c34-842b-ad80c0518886', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-3d23f438-7de6-4bbb-8362-5c45b046b652', 'type': 'alarm', 'uuid': 'a089e3e6-e2d9-4c34-842b-ad80c0518886'} 06/02/2025 02:07:57.975 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'fq_name': ['default-global-system-config', 'assisted-replicator'], 'id_perms': {'created': '2025-06-02T02:07:57.957102', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:57.957102', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9814971648245012717, 'uuid_mslong': 11347942896867426906}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9d7bfdf0-d333-425a-8835-c8b64e2c98ed'}, 'oper': 'CREATE', 'request-id': 'req-c047e3c0-d45b-408f-afb4-de8b763cefca', 'type': 'feature', 'uuid': '9d7bfdf0-d333-425a-8835-c8b64e2c98ed'} 06/02/2025 02:07:58.005 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-xmpp-connectivity'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-xmpp-connectivity 06/02/2025 02:07:58.014 7fad86267390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP peer mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-connectivity"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.014 7fad86267390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP peer mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-connectivity"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.042 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_xmpp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'id_perms': {'created': '2025-06-02T02:07:58.033261', 'creator': None, 'description': 'XMPP peer mismatch.', 'enable': True, 'last_modified': '2025-06-02T02:07:58.033261', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11087530321449906522, 'uuid_mslong': 4421020504493278219}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3d5a9eb9-ab0a-440b-99de-d2154664f15a', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-c241f653-779c-4e79-8f69-122fe5827caa', 'type': 'alarm', 'uuid': '3d5a9eb9-ab0a-440b-99de-d2154664f15a'} 06/02/2025 02:07:58.073 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'port-profile'] not found in DB: Unknown id: feature default-global-system-config:port-profile 06/02/2025 02:07:58.087 7fad853baac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:port-profile url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "port-profile"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "port-profile"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.087 7fad853baac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:port-profile url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "port-profile"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "port-profile"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.094 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-xmpp-close-reason'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-xmpp-close-reason 06/02/2025 02:07:58.103 7fad853b8438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP connection closed towards peer, alarm has close reason", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-close-reason"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.105 7fad853b8438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP connection closed towards peer, alarm has close reason", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-close-reason"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.123 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'port-profile'], 'obj_dict': {'display_name': 'port-profile', 'fq_name': ['default-global-system-config', 'port-profile'], 'id_perms': {'created': '2025-06-02T02:07:58.113536', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:58.113536', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13220254450659154303, 'uuid_mslong': 5747566159288422259}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4fc374f8-4f71-4f73-b777-c76103d0d97f'}, 'oper': 'CREATE', 'request-id': 'req-5c63f2a6-53c7-4c67-9cce-d8d4ce1b5c94', 'type': 'feature', 'uuid': '4fc374f8-4f71-4f73-b777-c76103d0d97f'} 06/02/2025 02:07:58.149 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'XmppPeerInfoData.close_reason', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'XmppPeerInfoData.state_info.state', 'operand2': {'json_value': '"Established"'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-close-reason', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'id_perms': {'created': '2025-06-02T02:07:58.136666', 'creator': None, 'description': 'XMPP connection closed towards ' 'peer, ' 'alarm has close reason', 'enable': True, 'last_modified': '2025-06-02T02:07:58.136666', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12501345501673288512, 'uuid_mslong': 12481025253580293097}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ad358257-4055-43e9-ad7d-b37fb1a9f340', 'uve_keys': {'uve_key': ['xmpp-peer']}}, 'oper': 'CREATE', 'request-id': 'req-37ade60a-5d05-4f93-9d1a-871d9475a1e3', 'type': 'alarm', 'uuid': 'ad358257-4055-43e9-ad7d-b37fb1a9f340'} 06/02/2025 02:07:58.197 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-core-files'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-core-files 06/02/2025 02:07:58.203 7fad853ba240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "A core file has been generated on the node.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-core-files"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.203 7fad853ba240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "A core file has been generated on the node.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-core-files"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.224 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'telemetry'] not found in DB: Unknown id: feature default-global-system-config:telemetry 06/02/2025 02:07:58.234 7fad85557a20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:telemetry url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "telemetry"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "telemetry"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.234 7fad85557a20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:telemetry url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "telemetry"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "telemetry"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.238 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-core-files', 'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'id_perms': {'created': '2025-06-02T02:07:58.223084', 'creator': None, 'description': 'A core file has been generated on ' 'the node.', 'enable': True, 'last_modified': '2025-06-02T02:07:58.223084', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12771206573359741803, 'uuid_mslong': 17747060515201696623}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f64a3982-b7f5-436f-b13c-70b6b63dbb6b', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-99cf43ed-14c5-4309-9877-4a44d8ff5386', 'type': 'alarm', 'uuid': 'f64a3982-b7f5-436f-b13c-70b6b63dbb6b'} 06/02/2025 02:07:58.259 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'telemetry'], 'obj_dict': {'display_name': 'telemetry', 'fq_name': ['default-global-system-config', 'telemetry'], 'id_perms': {'created': '2025-06-02T02:07:58.251550', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:58.251550', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12039805069471538132, 'uuid_mslong': 4378213498077201099}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3cc289fa-cfb6-42cb-a715-faebcacc5bd4'}, 'oper': 'CREATE', 'request-id': 'req-f05034fe-0d24-42d6-b5e0-3d539e052fb8', 'type': 'feature', 'uuid': '3cc289fa-cfb6-42cb-a715-faebcacc5bd4'} 06/02/2025 02:07:58.293 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-pending-cassandra-compaction-tasks 06/02/2025 02:07:58.305 7fad8517c828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Pending compaction tasks in cassandra crossed the configured threshold.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-pending-cassandra-compaction-tasks"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.305 7fad8517c828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Pending compaction tasks in cassandra crossed the configured threshold.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-pending-cassandra-compaction-tasks"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.334 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks', 'operand2': {'json_value': '300'}, 'operation': '>='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-pending-cassandra-compaction-tasks', 'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'id_perms': {'created': '2025-06-02T02:07:58.324399', 'creator': None, 'description': 'Pending compaction tasks in ' 'cassandra crossed the configured ' 'threshold.', 'enable': True, 'last_modified': '2025-06-02T02:07:58.324399', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10449716296908382558, 'uuid_mslong': 5638199005075686035}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4e3ee81f-667f-4293-9104-d99b68d5a15e', 'uve_keys': {'uve_key': ['database-nodeconfig-database-node']}}, 'oper': 'CREATE', 'request-id': 'req-4059e8f9-5670-4089-9618-f21fd9a80db1', 'type': 'alarm', 'uuid': '4e3ee81f-667f-4293-9104-d99b68d5a15e'} 06/02/2025 02:07:58.361 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'firewall'] not found in DB: Unknown id: feature default-global-system-config:firewall 06/02/2025 02:07:58.367 7fad85c6b4e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:firewall url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "firewall"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "firewall"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.367 7fad85c6b4e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:firewall url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "firewall"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "firewall"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.379 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-package-version-mismatch'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-package-version-mismatch 06/02/2025 02:07:58.385 7fad84365cc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "There is a mismatch between installed and running package version.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-package-version-mismatch"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.385 7fad84365cc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "There is a mismatch between installed and running package version.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-package-version-mismatch"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.395 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'firewall'], 'obj_dict': {'display_name': 'firewall', 'fq_name': ['default-global-system-config', 'firewall'], 'id_perms': {'created': '2025-06-02T02:07:58.382936', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:58.382936', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11425928428796232927, 'uuid_mslong': 14628687717528453644}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cb0389f9-1567-420c-9e91-0d5e6b6fc4df'}, 'oper': 'CREATE', 'request-id': 'req-58cb8194-7ddf-42eb-867e-0bbbeabeab84', 'type': 'feature', 'uuid': 'cb0389f9-1567-420c-9e91-0d5e6b6fc4df'} 06/02/2025 02:07:58.428 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.running_package_version', 'operand2': {'uve_attribute': 'NodeStatus.installed_package_version'}, 'operation': '!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-package-version-mismatch', 'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'id_perms': {'created': '2025-06-02T02:07:58.406990', 'creator': None, 'description': 'There is a mismatch between ' 'installed and running package ' 'version.', 'enable': True, 'last_modified': '2025-06-02T02:07:58.406990', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12703834909842901183, 'uuid_mslong': 342178574605567111}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '04bfa999-c51d-4487-b04d-168aee6488bf', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-ecaeaa4f-4a93-40ee-9496-7524ac2ad10b', 'type': 'alarm', 'uuid': '04bfa999-c51d-4487-b04d-168aee6488bf'} 06/02/2025 02:07:58.470 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-vrouter-limit-exceeded 06/02/2025 02:07:58.475 7fad855c9c18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded configured watermark for resource.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-limit-exceeded"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.475 7fad855c9c18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded configured watermark for resource.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-limit-exceeded"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.495 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'infra-bms-access'] not found in DB: Unknown id: feature default-global-system-config:infra-bms-access 06/02/2025 02:07:58.499 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'id_perms': {'created': '2025-06-02T02:07:58.487189', 'creator': None, 'description': 'Agent resource usage exceeded ' 'configured watermark for resource.', 'enable': True, 'last_modified': '2025-06-02T02:07:58.487189', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10715054919550418984, 'uuid_mslong': 1185508557487098417}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1073c5c0-7f34-4a31-94b3-85adb49ac028', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-1d25d4dc-2bf7-4388-8e62-95475d20758e', 'type': 'alarm', 'uuid': '1073c5c0-7f34-4a31-94b3-85adb49ac028'} 06/02/2025 02:07:58.508 7fad85448978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:infra-bms-access url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "infra-bms-access"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "infra-bms-access"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.509 7fad85448978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:infra-bms-access url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "infra-bms-access"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "infra-bms-access"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.542 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-vrouter-table-limit-exceeded 06/02/2025 02:07:58.544 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'infra-bms-access'], 'obj_dict': {'display_name': 'infra-bms-access', 'fq_name': ['default-global-system-config', 'infra-bms-access'], 'id_perms': {'created': '2025-06-02T02:07:58.523733', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:58.523733', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12520898804820261677, 'uuid_mslong': 11132576841115324111}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d'}, 'oper': 'CREATE', 'request-id': 'req-ce71354f-ae3e-4736-a4f5-6521285b5035', 'type': 'feature', 'uuid': '9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d'} 06/02/2025 02:07:58.550 7fad853e30f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded table size for resource in vrouter.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-table-limit-exceeded"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.550 7fad853e30f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded table size for resource in vrouter.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-table-limit-exceeded"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.574 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_table_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-table-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'id_perms': {'created': '2025-06-02T02:07:58.564958', 'creator': None, 'description': 'Agent resource usage exceeded table ' 'size for resource in vrouter.', 'enable': True, 'last_modified': '2025-06-02T02:07:58.564958', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12532625623950756320, 'uuid_mslong': 15730924609939326407}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'da4f7896-33e2-45c7-adec-d49ab28b09e0', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-8c7df820-39f5-47b9-9e6b-a6ce94da6a4d', 'type': 'alarm', 'uuid': 'da4f7896-33e2-45c7-adec-d49ab28b09e0'} 06/02/2025 02:07:58.620 7fad85442978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down 06/02/2025 02:07:58.626 7fad8545f390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "On l3 multihomed compute one or more physical interfaces are Inactive.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-l3mh-physical-interface-link-down"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.626 7fad8545f390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = https://10.0.0.129:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.129 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "On l3 multihomed compute one or more physical interfaces are Inactive.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-l3mh-physical-interface-link-down"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.640 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'pnf-service-chaining'] not found in DB: Unknown id: feature default-global-system-config:pnf-service-chaining 06/02/2025 02:07:58.649 7fad854b4048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:pnf-service-chaining url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-service-chaining"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-service-chaining"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.649 7fad854b4048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:pnf-service-chaining url = https://10.0.0.129:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-service-chaining"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-service-chaining"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.653 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.l3mh_phy_interface_down', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_l3mh_intf_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-l3mh-physical-interface-link-down', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'id_perms': {'created': '2025-06-02T02:07:58.643277', 'creator': None, 'description': 'On l3 multihomed compute one or ' 'more physical interfaces are ' 'Inactive.', 'enable': True, 'last_modified': '2025-06-02T02:07:58.643277', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13776365635368127319, 'uuid_mslong': 15111484563441272510}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd1b6c725-78b7-46be-bf2f-7b8e18040b57', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-f055c867-94c1-4d56-9a6c-a7ae577da97d', 'type': 'alarm', 'uuid': 'd1b6c725-78b7-46be-bf2f-7b8e18040b57'} 06/02/2025 02:07:58.683 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-service-chaining'], 'obj_dict': {'display_name': 'pnf-service-chaining', 'fq_name': ['default-global-system-config', 'pnf-service-chaining'], 'id_perms': {'created': '2025-06-02T02:07:58.667390', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:58.667390', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10667602345714512130, 'uuid_mslong': 13488683406460471255}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bb316e17-91c8-47d7-940a-efd0656ff102'}, 'oper': 'CREATE', 'request-id': 'req-224c3a12-148e-4f57-bf29-2c168b6d76ef', 'type': 'feature', 'uuid': 'bb316e17-91c8-47d7-940a-efd0656ff102'} 06/02/2025 02:07:58.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:58.789 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'leaf'] not found in DB: Unknown id: physical_role default-global-system-config:leaf 06/02/2025 02:07:58.795 7fad852b72e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:leaf url = https://10.0.0.129:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.795 7fad852b72e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:leaf url = https://10.0.0.129:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.818 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'leaf'], 'obj_dict': {'display_name': 'leaf', 'fq_name': ['default-global-system-config', 'leaf'], 'id_perms': {'created': '2025-06-02T02:07:58.811040', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:58.811040', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12819457136730456980, 'uuid_mslong': 11228443137952533110}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9bd3718b-0a55-4a76-b1e7-dc58702a4394'}, 'oper': 'CREATE', 'request-id': 'req-312a826f-4407-449d-abcb-3a97335bbb65', 'type': 'physical_role', 'uuid': '9bd3718b-0a55-4a76-b1e7-dc58702a4394'} 06/02/2025 02:07:58.912 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'spine'] not found in DB: Unknown id: physical_role default-global-system-config:spine 06/02/2025 02:07:58.918 7fad854b4198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:spine url = https://10.0.0.129:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.918 7fad854b4198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:spine url = https://10.0.0.129:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:58.936 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'spine'], 'obj_dict': {'display_name': 'spine', 'fq_name': ['default-global-system-config', 'spine'], 'id_perms': {'created': '2025-06-02T02:07:58.929184', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:58.929184', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12794529527416922197, 'uuid_mslong': 2347898813049816049}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '20956987-e065-43f1-b18f-4cd11deea055'}, 'oper': 'CREATE', 'request-id': 'req-fb74cfe0-19dc-4954-989d-7450e7abb3f0', 'type': 'physical_role', 'uuid': '20956987-e065-43f1-b18f-4cd11deea055'} 06/02/2025 02:07:59.032 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'superspine'] not found in DB: Unknown id: physical_role default-global-system-config:superspine 06/02/2025 02:07:59.037 7fad853e3780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:superspine url = https://10.0.0.129:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "superspine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "superspine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:59.037 7fad853e3780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:superspine url = https://10.0.0.129:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "superspine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "superspine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:59.071 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'superspine'], 'obj_dict': {'display_name': 'superspine', 'fq_name': ['default-global-system-config', 'superspine'], 'id_perms': {'created': '2025-06-02T02:07:59.050285', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:59.050285', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11050800495694208892, 'uuid_mslong': 14219445017400004519}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c5559de7-cd53-4fa7-995c-54804d905f7c'}, 'oper': 'CREATE', 'request-id': 'req-457befae-b1d7-4609-8558-61bf9cfae7fd', 'type': 'physical_role', 'uuid': 'c5559de7-cd53-4fa7-995c-54804d905f7c'} 06/02/2025 02:07:59.161 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'pnf'] not found in DB: Unknown id: physical_role default-global-system-config:pnf 06/02/2025 02:07:59.169 7fad8552dd68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:pnf url = https://10.0.0.129:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "pnf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:59.169 7fad8552dd68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:pnf url = https://10.0.0.129:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "pnf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:59.204 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf'], 'obj_dict': {'display_name': 'pnf', 'fq_name': ['default-global-system-config', 'pnf'], 'id_perms': {'created': '2025-06-02T02:07:59.193251', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:59.193251', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10763747163996916537, 'uuid_mslong': 7532980315918846827}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '688a85af-965a-4b6b-9560-830452278b39'}, 'oper': 'CREATE', 'request-id': 'req-96615dbc-34cc-4ecb-928b-96d83c4d55f9', 'type': 'physical_role', 'uuid': '688a85af-965a-4b6b-9560-830452278b39'} 06/02/2025 02:07:59.302 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'erb-ucast-gateway'] not found in DB: Unknown id: overlay_role default-global-system-config:erb-ucast-gateway 06/02/2025 02:07:59.308 7fad8517ceb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:erb-ucast-gateway url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "erb-ucast-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "erb-ucast-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:59.309 7fad8517ceb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:erb-ucast-gateway url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "erb-ucast-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "erb-ucast-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:59.338 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-ucast-gateway'], 'obj_dict': {'display_name': 'erb-ucast-gateway', 'fq_name': ['default-global-system-config', 'erb-ucast-gateway'], 'id_perms': {'created': '2025-06-02T02:07:59.321999', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:59.321999', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12278463810525203548, 'uuid_mslong': 2917115583811110311}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '287bad2a-fdd1-45a7-aa65-ddc815d80c5c'}, 'oper': 'CREATE', 'request-id': 'req-391ca286-1ba4-4c03-9b8f-dd80ff0254f2', 'type': 'overlay_role', 'uuid': '287bad2a-fdd1-45a7-aa65-ddc815d80c5c'} 06/02/2025 02:07:59.451 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-access'] not found in DB: Unknown id: overlay_role default-global-system-config:crb-access 06/02/2025 02:07:59.476 7fad8545f438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-access url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:59.477 7fad8545f438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-access url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:59.523 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access'], 'obj_dict': {'display_name': 'crb-access', 'fq_name': ['default-global-system-config', 'crb-access'], 'id_perms': {'created': '2025-06-02T02:07:59.508298', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:59.508298', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13085374724456900538, 'uuid_mslong': 7128060129827110918}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '62ebf4ec-07f8-4006-b598-96fb8c20e7ba'}, 'oper': 'CREATE', 'request-id': 'req-bef5c65a-324f-4eaa-89ca-d2d3c329f333', 'type': 'overlay_role', 'uuid': '62ebf4ec-07f8-4006-b598-96fb8c20e7ba'} 06/02/2025 02:07:59.558 7fad858210f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 26ae01a2-4559-44e7-8a63-b8afe58aeb73 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = https://10.0.0.129:8082/global-vrouter-config/26ae01a2-4559-44e7-8a63-b8afe58aeb73 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.129 body = {"global-vrouter-config": {"uuid": "26ae01a2-4559-44e7-8a63-b8afe58aeb73", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:59.558 7fad858210f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 26ae01a2-4559-44e7-8a63-b8afe58aeb73 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = https://10.0.0.129:8082/global-vrouter-config/26ae01a2-4559-44e7-8a63-b8afe58aeb73 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.129 body = {"global-vrouter-config": {"uuid": "26ae01a2-4559-44e7-8a63-b8afe58aeb73", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:59.572 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-c1c00e0e-1d19-48ce-a8d8-1c21376b5d50', 'type': 'global_vrouter_config', 'uuid': '26ae01a2-4559-44e7-8a63-b8afe58aeb73'} 06/02/2025 02:07:59.616 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-mcast-gateway'] not found in DB: Unknown id: overlay_role default-global-system-config:crb-mcast-gateway 06/02/2025 02:07:59.621 7fad85287f60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-mcast-gateway url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-mcast-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-mcast-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:59.621 7fad85287f60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-mcast-gateway url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-mcast-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-mcast-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:59.761 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'obj_dict': {'display_name': 'crb-mcast-gateway', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'id_perms': {'created': '2025-06-02T02:07:59.755193', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:59.755193', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13349165115216191165, 'uuid_mslong': 3523443313428547261}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '30e5c906-8b22-46bd-b941-c2f2047f5ebd'}, 'oper': 'CREATE', 'request-id': 'req-148a3c17-b9a1-4af5-b775-8f0e179a7161', 'type': 'overlay_role', 'uuid': '30e5c906-8b22-46bd-b941-c2f2047f5ebd'} 06/02/2025 02:07:59.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:07:59.867 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-gateway'] not found in DB: Unknown id: overlay_role default-global-system-config:crb-gateway 06/02/2025 02:07:59.873 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-gateway url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:59.882 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-gateway url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:07:59.909 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway'], 'obj_dict': {'display_name': 'crb-gateway', 'fq_name': ['default-global-system-config', 'crb-gateway'], 'id_perms': {'created': '2025-06-02T02:07:59.897512', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:07:59.897512', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13193010968754249524, 'uuid_mslong': 16069096923265060547}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'df00e683-9489-4ec3-b716-fd93966ddf34'}, 'oper': 'CREATE', 'request-id': 'req-3ed66d7c-b13a-4329-a357-b061a97afdd7', 'type': 'overlay_role', 'uuid': 'df00e683-9489-4ec3-b716-fd93966ddf34'} 06/02/2025 02:08:00.018 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'collapsed-spine'] not found in DB: Unknown id: overlay_role default-global-system-config:collapsed-spine 06/02/2025 02:08:00.025 7fad852e1e10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "collapsed-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "collapsed-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.025 7fad852e1e10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "collapsed-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "collapsed-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.059 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'obj_dict': {'display_name': 'collapsed-spine', 'fq_name': ['default-global-system-config', 'collapsed-spine'], 'id_perms': {'created': '2025-06-02T02:08:00.045246', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:00.045246', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12445951910998402382, 'uuid_mslong': 2554063376724413424}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2371db1b-ef7e-4bf0-acb8-e75252a7654e'}, 'oper': 'CREATE', 'request-id': 'req-dbfcad90-0e22-4f9f-962f-32a2f93741d9', 'type': 'overlay_role', 'uuid': '2371db1b-ef7e-4bf0-acb8-e75252a7654e'} 06/02/2025 02:08:00.158 7fad855c9048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 30e5c906-8b22-46bd-b941-c2f2047f5ebd object_type = overlay_role identifier_name = default-global-system-config:crb-mcast-gateway url = https://10.0.0.129:8082/overlay-role/30e5c906-8b22-46bd-b941-c2f2047f5ebd operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": "30e5c906-8b22-46bd-b941-c2f2047f5ebd", "fq_name": ["default-global-system-config", "crb-mcast-gateway"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.158 7fad855c9048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 30e5c906-8b22-46bd-b941-c2f2047f5ebd object_type = overlay_role identifier_name = default-global-system-config:crb-mcast-gateway url = https://10.0.0.129:8082/overlay-role/30e5c906-8b22-46bd-b941-c2f2047f5ebd operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": "30e5c906-8b22-46bd-b941-c2f2047f5ebd", "fq_name": ["default-global-system-config", "crb-mcast-gateway"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.171 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'oper': 'UPDATE', 'request-id': 'req-7ca63f9c-3e4e-418d-94f3-f641dc54c9aa', 'type': 'overlay_role', 'uuid': '30e5c906-8b22-46bd-b941-c2f2047f5ebd'} 06/02/2025 02:08:00.276 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'dc-gateway'] not found in DB: Unknown id: overlay_role default-global-system-config:dc-gateway 06/02/2025 02:08:00.282 7fad853d4438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:dc-gateway url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.282 7fad853d4438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:dc-gateway url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.311 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway'], 'obj_dict': {'display_name': 'dc-gateway', 'fq_name': ['default-global-system-config', 'dc-gateway'], 'id_perms': {'created': '2025-06-02T02:08:00.295978', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:00.295978', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10723366588568584711, 'uuid_mslong': 2004949398206235118}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1bd302da-e0b7-41ee-94d1-0d18f3ec4207'}, 'oper': 'CREATE', 'request-id': 'req-2eb223ac-e4ec-4830-b0d7-4106c0363225', 'type': 'overlay_role', 'uuid': '1bd302da-e0b7-41ee-94d1-0d18f3ec4207'} 06/02/2025 02:08:00.402 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'dci-gateway'] not found in DB: Unknown id: overlay_role default-global-system-config:dci-gateway 06/02/2025 02:08:00.410 7fad853da828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:dci-gateway url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "dci-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dci-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.410 7fad853da828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:dci-gateway url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "dci-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dci-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.444 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway'], 'obj_dict': {'display_name': 'dci-gateway', 'fq_name': ['default-global-system-config', 'dci-gateway'], 'id_perms': {'created': '2025-06-02T02:08:00.430785', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:00.430785', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12529166363220024556, 'uuid_mslong': 15694149056546882759}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd9ccd16a-6f82-44c7-ade0-8a6ccb809cec'}, 'oper': 'CREATE', 'request-id': 'req-8962e63d-3f83-43b3-a2a3-ce717f1f27b4', 'type': 'overlay_role', 'uuid': 'd9ccd16a-6f82-44c7-ade0-8a6ccb809cec'} 06/02/2025 02:08:00.470 7fad851efc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_objects in resource global-vrouter-config: 'security_logging_objects' 06/02/2025 02:08:00.470 7fad851efc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-vrouter-config: 'tag_refs' 06/02/2025 02:08:00.470 7fad851efc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field application_policy_set_back_refs in resource global-vrouter-config: 'application_policy_set_back_refs' 06/02/2025 02:08:00.544 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-client'] not found in DB: Unknown id: overlay_role default-global-system-config:ar-client 06/02/2025 02:08:00.553 7fad85192978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:ar-client url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-client"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.553 7fad85192978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:ar-client url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-client"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.580 7fad858158d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 26ae01a2-4559-44e7-8a63-b8afe58aeb73 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = https://10.0.0.129:8082/global-vrouter-config/26ae01a2-4559-44e7-8a63-b8afe58aeb73 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.129 body = {"global-vrouter-config": {"uuid": "26ae01a2-4559-44e7-8a63-b8afe58aeb73", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.580 7fad858158d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 26ae01a2-4559-44e7-8a63-b8afe58aeb73 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = https://10.0.0.129:8082/global-vrouter-config/26ae01a2-4559-44e7-8a63-b8afe58aeb73 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.129 body = {"global-vrouter-config": {"uuid": "26ae01a2-4559-44e7-8a63-b8afe58aeb73", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.587 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client'], 'obj_dict': {'display_name': 'ar-client', 'fq_name': ['default-global-system-config', 'ar-client'], 'id_perms': {'created': '2025-06-02T02:08:00.576614', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:00.576614', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9429735558016799198, 'uuid_mslong': 3907816093270362043}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '363b5a08-46ef-47bb-82dd-2687757611de'}, 'oper': 'CREATE', 'request-id': 'req-40637d62-13de-4695-b2b0-d37a6244f8b0', 'type': 'overlay_role', 'uuid': '363b5a08-46ef-47bb-82dd-2687757611de'} 06/02/2025 02:08:00.600 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-1103624b-f0ca-42c0-ae2d-faf193c488a4', 'type': 'global_vrouter_config', 'uuid': '26ae01a2-4559-44e7-8a63-b8afe58aeb73'} 06/02/2025 02:08:00.687 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-replicator'] not found in DB: Unknown id: overlay_role default-global-system-config:ar-replicator 06/02/2025 02:08:00.693 7fad85fa6978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:ar-replicator url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "ar-replicator"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-replicator"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.693 7fad85fa6978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:ar-replicator url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "ar-replicator"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-replicator"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.717 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator'], 'obj_dict': {'display_name': 'ar-replicator', 'fq_name': ['default-global-system-config', 'ar-replicator'], 'id_perms': {'created': '2025-06-02T02:08:00.708410', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:00.708410', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12853054599606583771, 'uuid_mslong': 1934536840752417156}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1ad8db01-cdf4-4984-b25f-390f584041db'}, 'oper': 'CREATE', 'request-id': 'req-70ebeb5f-d481-41f4-afa2-88a04577aab7', 'type': 'overlay_role', 'uuid': '1ad8db01-cdf4-4984-b25f-390f584041db'} 06/02/2025 02:08:00.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:00.822 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'route-reflector'] not found in DB: Unknown id: overlay_role default-global-system-config:route-reflector 06/02/2025 02:08:00.829 7fad85815978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:route-reflector url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "route-reflector"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "route-reflector"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.829 7fad85815978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:route-reflector url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "route-reflector"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "route-reflector"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.860 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'route-reflector'], 'obj_dict': {'display_name': 'route-reflector', 'fq_name': ['default-global-system-config', 'route-reflector'], 'id_perms': {'created': '2025-06-02T02:08:00.844047', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:00.844047', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12158542668218502634, 'uuid_mslong': 3170893251132670399}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2c01469c-9e72-41bf-a8bb-d22355980dea'}, 'oper': 'CREATE', 'request-id': 'req-602e310e-e46b-4f1b-ab28-f7169904fd3e', 'type': 'overlay_role', 'uuid': '2c01469c-9e72-41bf-a8bb-d22355980dea'} 06/02/2025 02:08:00.948 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'lean'] not found in DB: Unknown id: overlay_role default-global-system-config:lean 06/02/2025 02:08:00.954 7fad852daf60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:lean url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "lean"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "lean"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.954 7fad852daf60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:lean url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "lean"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "lean"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:00.993 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean'], 'obj_dict': {'display_name': 'lean', 'fq_name': ['default-global-system-config', 'lean'], 'id_perms': {'created': '2025-06-02T02:08:00.967676', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:00.967676', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12634460963347453585, 'uuid_mslong': 12849795298985853632}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b253a4be-4889-42c0-af56-9f4e50dd5691'}, 'oper': 'CREATE', 'request-id': 'req-545357ea-8010-44ce-83bb-1f65bfc04d70', 'type': 'overlay_role', 'uuid': 'b253a4be-4889-42c0-af56-9f4e50dd5691'} 06/02/2025 02:08:01.093 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'pnf-servicechain'] not found in DB: Unknown id: overlay_role default-global-system-config:pnf-servicechain 06/02/2025 02:08:01.101 7fad85190d68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:pnf-servicechain url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-servicechain"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-servicechain"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.102 7fad85190d68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:pnf-servicechain url = https://10.0.0.129:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-servicechain"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-servicechain"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.137 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain'], 'obj_dict': {'display_name': 'pnf-servicechain', 'fq_name': ['default-global-system-config', 'pnf-servicechain'], 'id_perms': {'created': '2025-06-02T02:08:01.124458', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:01.124458', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13410608759490318629, 'uuid_mslong': 17130449351852114874}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'edbb94ec-abf7-43ba-ba1c-0d9d43299125'}, 'oper': 'CREATE', 'request-id': 'req-64a73f7d-3d9d-4242-aa64-c5664c4f50d3', 'type': 'overlay_role', 'uuid': 'edbb94ec-abf7-43ba-ba1c-0d9d43299125'} 06/02/2025 02:08:01.228 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'erb-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:erb-leaf 06/02/2025 02:08:01.235 7fad854cdd68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "erb-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "erb-leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.235 7fad854cdd68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "erb-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "erb-leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.260 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'obj_dict': {'display_name': 'erb-leaf', 'fq_name': ['default-global-system-config', 'erb-leaf'], 'id_perms': {'created': '2025-06-02T02:08:01.250708', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:01.250708', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13754370834591983351, 'uuid_mslong': 16804995759545992431}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e937569b-4baf-44ef-bee1-576678d926f7'}, 'oper': 'CREATE', 'request-id': 'req-7ef44f98-c973-48f6-91cf-26419b16289f', 'type': 'role_definition', 'uuid': 'e937569b-4baf-44ef-bee1-576678d926f7'} 06/02/2025 02:08:01.363 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-access-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:crb-access-leaf 06/02/2025 02:08:01.371 7fad85620048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access-leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.371 7fad85620048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access-leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.401 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'obj_dict': {'display_name': 'crb-access-leaf', 'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'id_perms': {'created': '2025-06-02T02:08:01.385375', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:01.385375', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13450924589147142916, 'uuid_mslong': 8397996613163239033}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '748bad6c-d887-4679-baab-48a5d4aebb04'}, 'oper': 'CREATE', 'request-id': 'req-976c7860-d73b-44b8-9174-fd0918224a7c', 'type': 'role_definition', 'uuid': '748bad6c-d887-4679-baab-48a5d4aebb04'} 06/02/2025 02:08:01.507 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-access-spine'] not found in DB: Unknown id: role_definition default-global-system-config:crb-access-spine 06/02/2025 02:08:01.514 7fad8571b2e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.515 7fad8571b2e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.555 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'obj_dict': {'display_name': 'crb-access-spine', 'fq_name': ['default-global-system-config', 'crb-access-spine'], 'id_perms': {'created': '2025-06-02T02:08:01.537103', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:01.537103', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10040374827330036922, 'uuid_mslong': 2474187068556855166}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '22561407-b132-477e-8b56-93b592c7e4ba'}, 'oper': 'CREATE', 'request-id': 'req-a7eecde0-4b7c-4099-8aa8-974724b6971e', 'type': 'role_definition', 'uuid': '22561407-b132-477e-8b56-93b592c7e4ba'} 06/02/2025 02:08:01.646 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-gateway-spine'] not found in DB: Unknown id: role_definition default-global-system-config:crb-gateway-spine 06/02/2025 02:08:01.655 7fad86204588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-gateway-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.656 7fad86204588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-gateway-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.685 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'obj_dict': {'display_name': 'crb-gateway-spine', 'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'id_perms': {'created': '2025-06-02T02:08:01.676198', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:01.676198', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11914063034327297768, 'uuid_mslong': 8937649742997638617}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7c08e916-6a3c-4dd9-a557-4134d0b0eee8'}, 'oper': 'CREATE', 'request-id': 'req-c76a032b-8e81-4e76-8277-d93ed3673331', 'type': 'role_definition', 'uuid': '7c08e916-6a3c-4dd9-a557-4134d0b0eee8'} 06/02/2025 02:08:01.717 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 06/02/2025 02:08:01.718 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 06/02/2025 02:08:01.718 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 06/02/2025 02:08:01.718 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 06/02/2025 02:08:01.718 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 06/02/2025 02:08:01.718 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 06/02/2025 02:08:01.718 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 06/02/2025 02:08:01.718 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 06/02/2025 02:08:01.718 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 06/02/2025 02:08:01.718 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 06/02/2025 02:08:01.719 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 06/02/2025 02:08:01.719 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 06/02/2025 02:08:01.719 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 06/02/2025 02:08:01.719 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 06/02/2025 02:08:01.719 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 06/02/2025 02:08:01.719 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 06/02/2025 02:08:01.719 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 06/02/2025 02:08:01.719 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 06/02/2025 02:08:01.719 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 06/02/2025 02:08:01.719 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 06/02/2025 02:08:01.720 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 06/02/2025 02:08:01.720 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 06/02/2025 02:08:01.720 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 06/02/2025 02:08:01.720 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 06/02/2025 02:08:01.720 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 06/02/2025 02:08:01.720 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 06/02/2025 02:08:01.720 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 06/02/2025 02:08:01.720 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 06/02/2025 02:08:01.720 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 06/02/2025 02:08:01.720 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 06/02/2025 02:08:01.720 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 06/02/2025 02:08:01.720 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 06/02/2025 02:08:01.721 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 06/02/2025 02:08:01.721 7fad8583b390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 06/02/2025 02:08:01.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:01.778 7fad855e8ac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3b45d35b-de57-4285-b542-427e524b5c84 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.129:8082/global-system-config/3b45d35b-de57-4285-b542-427e524b5c84 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.129 body = {"global-system-config": {"uuid": "3b45d35b-de57-4285-b542-427e524b5c84", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.778 7fad855e8ac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3b45d35b-de57-4285-b542-427e524b5c84 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.129:8082/global-system-config/3b45d35b-de57-4285-b542-427e524b5c84 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.129 body = {"global-system-config": {"uuid": "3b45d35b-de57-4285-b542-427e524b5c84", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.788 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-mcast-gateway-spine'] not found in DB: Unknown id: role_definition default-global-system-config:crb-mcast-gateway-spine 06/02/2025 02:08:01.797 7fad8571bc18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-mcast-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-mcast-gateway-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.798 7fad8571bc18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-mcast-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-mcast-gateway-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.811 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-98a755d5-57f2-48a4-be6c-b8af0fec7d34', 'type': 'global_system_config', 'uuid': '3b45d35b-de57-4285-b542-427e524b5c84'} 06/02/2025 02:08:01.829 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'obj_dict': {'display_name': 'crb-mcast-gateway-spine', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'id_perms': {'created': '2025-06-02T02:08:01.814906', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:01.814906', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11598481364289817743, 'uuid_mslong': 17035576501280982989}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ec6a8691-ced8-47cd-a0f6-1559747b8c8f'}, 'oper': 'CREATE', 'request-id': 'req-fe528e3c-dc18-47a5-afa4-aad5d38cc3dd', 'type': 'role_definition', 'uuid': 'ec6a8691-ced8-47cd-a0f6-1559747b8c8f'} 06/02/2025 02:08:01.936 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'collapsed-spine'] not found in DB: Unknown id: role_definition default-global-system-config:collapsed-spine 06/02/2025 02:08:01.943 7fad853d4828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "collapsed-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "collapsed-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.943 7fad853d4828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "collapsed-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "collapsed-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:01.973 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'obj_dict': {'display_name': 'collapsed-spine', 'fq_name': ['default-global-system-config', 'collapsed-spine'], 'id_perms': {'created': '2025-06-02T02:08:01.964689', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:01.964689', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11715620089062226111, 'uuid_mslong': 9191548203319181415}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7f8ef064-5ab8-4067-a296-3e6623fbf8bf'}, 'oper': 'CREATE', 'request-id': 'req-6bfc7fbe-2548-4176-8625-b8f1b37274a6', 'type': 'role_definition', 'uuid': '7f8ef064-5ab8-4067-a296-3e6623fbf8bf'} 06/02/2025 02:08:02.070 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'dc-gateway-spine'] not found in DB: Unknown id: role_definition default-global-system-config:dc-gateway-spine 06/02/2025 02:08:02.076 7fad84cc90f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:02.076 7fad84cc90f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:02.103 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'obj_dict': {'display_name': 'dc-gateway-spine', 'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'id_perms': {'created': '2025-06-02T02:08:02.093314', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:02.093314', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12489926157290732243, 'uuid_mslong': 3894784270443367768}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '360d0da8-948e-4d58-ad55-21aa642c7ad3'}, 'oper': 'CREATE', 'request-id': 'req-d39d8d46-af38-4f04-9da5-f31f2471f31b', 'type': 'role_definition', 'uuid': '360d0da8-948e-4d58-ad55-21aa642c7ad3'} 06/02/2025 02:08:02.212 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'dci-gateway-spine'] not found in DB: Unknown id: role_definition default-global-system-config:dci-gateway-spine 06/02/2025 02:08:02.227 7fad8582db70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dci-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dci-gateway-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:02.227 7fad8582db70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dci-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dci-gateway-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:02.249 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'obj_dict': {'display_name': 'dci-gateway-spine', 'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'id_perms': {'created': '2025-06-02T02:08:02.242006', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:02.242006', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11499645624412360643, 'uuid_mslong': 8238078897473077394}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7253891c-2b86-4092-9f96-f2c485f94fc3'}, 'oper': 'CREATE', 'request-id': 'req-8eeb2181-5ea9-4fba-ba65-c1bc3c312992', 'type': 'role_definition', 'uuid': '7253891c-2b86-4092-9f96-f2c485f94fc3'} 06/02/2025 02:08:02.262 7fad86c7b198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:02.262 7fad86c7b198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:02.262 7fad86c7b198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:02.263 7fad86c7b198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:02.263 7fad86c7b198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:02.263 7fad86c7b198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:02.263 7fad86c7b198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:02.263 7fad86c7b198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:02.264 7fad86c7b198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:02.264 7fad86c7b198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:02.264 7fad86c7b198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:02.264 7fad86c7b198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:08:02.264 7fad86c7b198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:02.344 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-gateway-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:crb-gateway-leaf 06/02/2025 02:08:02.349 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-gateway-leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:02.372 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'obj_dict': {'display_name': 'crb-gateway-leaf', 'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'id_perms': {'created': '2025-06-02T02:08:02.362900', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:02.362900', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11686641002579001242, 'uuid_mslong': 8419556798504716746}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '74d8464c-ad19-49ca-a22f-4a12c83c7f9a'}, 'oper': 'CREATE', 'request-id': 'req-8bed72ec-32b6-4826-9628-2562223a82f0', 'type': 'role_definition', 'uuid': '74d8464c-ad19-49ca-a22f-4a12c83c7f9a'} 06/02/2025 02:08:02.464 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-mcast-gateway-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:crb-mcast-gateway-leaf 06/02/2025 02:08:02.469 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-mcast-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-mcast-gateway-leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:02.499 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'obj_dict': {'display_name': 'crb-mcast-gateway-leaf', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'id_perms': {'created': '2025-06-02T02:08:02.486838', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:02.486838', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11521968966696434519, 'uuid_mslong': 7691979837290137341}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6abf66e8-7d25-46fd-9fe6-41baad03fb57'}, 'oper': 'CREATE', 'request-id': 'req-da56b4bd-b86b-4a27-ba4e-6cf656785d40', 'type': 'role_definition', 'uuid': '6abf66e8-7d25-46fd-9fe6-41baad03fb57'} 06/02/2025 02:08:02.600 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'dc-gateway-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:dc-gateway-leaf 06/02/2025 02:08:02.606 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway-leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:02.631 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'obj_dict': {'display_name': 'dc-gateway-leaf', 'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'id_perms': {'created': '2025-06-02T02:08:02.622716', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:02.622716', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11260785244027672146, 'uuid_mslong': 10724152324673716400}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '94d3d7b8-655b-40b0-9c46-58846a3ad652'}, 'oper': 'CREATE', 'request-id': 'req-20d9569f-9141-4598-b5cc-9f775cd790d8', 'type': 'role_definition', 'uuid': '94d3d7b8-655b-40b0-9c46-58846a3ad652'} 06/02/2025 02:08:02.731 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'dci-gateway-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:dci-gateway-leaf 06/02/2025 02:08:02.736 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dci-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dci-gateway-leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:02.755 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'obj_dict': {'display_name': 'dci-gateway-leaf', 'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'id_perms': {'created': '2025-06-02T02:08:02.748295', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:02.748295', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12550582895429255909, 'uuid_mslong': 12851606299935918959}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5'}, 'oper': 'CREATE', 'request-id': 'req-1aa3b33c-0875-4608-a783-3a7be60de846', 'type': 'role_definition', 'uuid': 'b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5'} 06/02/2025 02:08:02.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:02.852 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-client-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:ar-client-leaf 06/02/2025 02:08:02.857 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-client-leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:02.876 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'obj_dict': {'display_name': 'ar-client-leaf', 'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'id_perms': {'created': '2025-06-02T02:08:02.870234', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:02.870234', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11649166390045180793, 'uuid_mslong': 9389834217558788551}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '824f6478-ad66-49c7-a1aa-271ca0100379'}, 'oper': 'CREATE', 'request-id': 'req-7fd17dfb-480c-481f-819e-b79d2a5ae63b', 'type': 'role_definition', 'uuid': '824f6478-ad66-49c7-a1aa-271ca0100379'} 06/02/2025 02:08:02.979 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-client-spine'] not found in DB: Unknown id: role_definition default-global-system-config:ar-client-spine 06/02/2025 02:08:02.984 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-client-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:03.014 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'obj_dict': {'display_name': 'ar-client-spine', 'fq_name': ['default-global-system-config', 'ar-client-spine'], 'id_perms': {'created': '2025-06-02T02:08:03.002125', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:03.002125', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13487132454573254997, 'uuid_mslong': 3022605670608883566}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '29f273d7-ccb9-4f6e-bb2b-eb82717b2955'}, 'oper': 'CREATE', 'request-id': 'req-74ae03a8-8768-41ad-8c5c-725a8d45e293', 'type': 'role_definition', 'uuid': '29f273d7-ccb9-4f6e-bb2b-eb82717b2955'} 06/02/2025 02:08:03.120 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-replicator-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:ar-replicator-leaf 06/02/2025 02:08:03.125 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-replicator-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-replicator-leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:03.149 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'obj_dict': {'display_name': 'ar-replicator-leaf', 'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'id_perms': {'created': '2025-06-02T02:08:03.137803', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:03.137803', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10288061635726108191, 'uuid_mslong': 2596738860410290406}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2409783c-4535-40e6-8ec6-898c98c7661f'}, 'oper': 'CREATE', 'request-id': 'req-38d1c9ab-591c-4314-a35b-88df6c4ddc75', 'type': 'role_definition', 'uuid': '2409783c-4535-40e6-8ec6-898c98c7661f'} 06/02/2025 02:08:03.239 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-replicator-spine'] not found in DB: Unknown id: role_definition default-global-system-config:ar-replicator-spine 06/02/2025 02:08:03.248 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-replicator-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-replicator-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:03.271 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'obj_dict': {'display_name': 'ar-replicator-spine', 'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'id_perms': {'created': '2025-06-02T02:08:03.263204', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:03.263204', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9543384926562122721, 'uuid_mslong': 16998749257549302598}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ebe7b062-f229-4b46-8470-ea07168d7be1'}, 'oper': 'CREATE', 'request-id': 'req-ac6d4d56-1a79-4d6a-8a34-7a5388679d64', 'type': 'role_definition', 'uuid': 'ebe7b062-f229-4b46-8470-ea07168d7be1'} 06/02/2025 02:08:03.368 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'rr-spine'] not found in DB: Unknown id: role_definition default-global-system-config:rr-spine 06/02/2025 02:08:03.375 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "rr-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "rr-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:03.399 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'obj_dict': {'display_name': 'rr-spine', 'fq_name': ['default-global-system-config', 'rr-spine'], 'id_perms': {'created': '2025-06-02T02:08:03.391120', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:03.391120', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12926725774602717021, 'uuid_mslong': 16661767998113137771}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e73a7db7-6981-446b-b364-f49a7014c75d'}, 'oper': 'CREATE', 'request-id': 'req-b79a756f-5fc7-47f8-88f2-879a0a522687', 'type': 'role_definition', 'uuid': 'e73a7db7-6981-446b-b364-f49a7014c75d'} 06/02/2025 02:08:03.498 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'rr-superspine'] not found in DB: Unknown id: role_definition default-global-system-config:rr-superspine 06/02/2025 02:08:03.505 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "rr-superspine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "rr-superspine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:03.535 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'obj_dict': {'display_name': 'rr-superspine', 'fq_name': ['default-global-system-config', 'rr-superspine'], 'id_perms': {'created': '2025-06-02T02:08:03.520343', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:03.520343', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12114702046167173799, 'uuid_mslong': 8942743175737395455}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7c1b0189-a360-48ff-a820-1153157e0aa7'}, 'oper': 'CREATE', 'request-id': 'req-ca9f68a0-3c58-481c-8679-ef94ba0a7979', 'type': 'role_definition', 'uuid': '7c1b0189-a360-48ff-a820-1153157e0aa7'} 06/02/2025 02:08:03.633 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'rr-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:rr-leaf 06/02/2025 02:08:03.639 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "rr-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "rr-leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:03.660 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'obj_dict': {'display_name': 'rr-leaf', 'fq_name': ['default-global-system-config', 'rr-leaf'], 'id_perms': {'created': '2025-06-02T02:08:03.653122', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:03.653122', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9700386806003203075, 'uuid_mslong': 10491314657577092997}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9198a318-7fbb-4785-869e-b267bbb4fc03'}, 'oper': 'CREATE', 'request-id': 'req-7cc470cc-bc5a-4871-8bb9-1c8bf4fea946', 'type': 'role_definition', 'uuid': '9198a318-7fbb-4785-869e-b267bbb4fc03'} 06/02/2025 02:08:03.768 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'lean-spine'] not found in DB: Unknown id: role_definition default-global-system-config:lean-spine 06/02/2025 02:08:03.775 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "lean-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "lean-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:03.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:03.795 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'obj_dict': {'display_name': 'lean-spine', 'fq_name': ['default-global-system-config', 'lean-spine'], 'id_perms': {'created': '2025-06-02T02:08:03.788683', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:03.788683', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9723959618279776001, 'uuid_mslong': 5889463689114304788}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '51bb9405-8338-4114-86f2-71c0c9cf1f01'}, 'oper': 'CREATE', 'request-id': 'req-0a7edc37-b452-4c7b-bb03-0f4e13053db7', 'type': 'role_definition', 'uuid': '51bb9405-8338-4114-86f2-71c0c9cf1f01'} 06/02/2025 02:08:03.898 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'lean-superspine'] not found in DB: Unknown id: role_definition default-global-system-config:lean-superspine 06/02/2025 02:08:03.902 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "lean-superspine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "lean-superspine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:03.932 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'obj_dict': {'display_name': 'lean-superspine', 'fq_name': ['default-global-system-config', 'lean-superspine'], 'id_perms': {'created': '2025-06-02T02:08:03.918899', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:03.918899', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10125924936929749172, 'uuid_mslong': 4632761173651309430}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '404adfbd-f4b5-4376-8c86-8314a7f7a8b4'}, 'oper': 'CREATE', 'request-id': 'req-bd13c3da-6f0b-4a1a-b55c-d81ea162eb1d', 'type': 'role_definition', 'uuid': '404adfbd-f4b5-4376-8c86-8314a7f7a8b4'} 06/02/2025 02:08:04.028 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'pnf-servicechain-pnf'] not found in DB: Unknown id: role_definition default-global-system-config:pnf-servicechain-pnf 06/02/2025 02:08:04.035 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-servicechain-pnf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-servicechain-pnf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:04.059 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'obj_dict': {'display_name': 'pnf-servicechain-pnf', 'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'id_perms': {'created': '2025-06-02T02:08:04.049629', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:04.049629', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9971428515722386224, 'uuid_mslong': 3089217906634934333}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2adf1b51-96c0-483d-8a61-a16776d55b30'}, 'oper': 'CREATE', 'request-id': 'req-68ff0952-3c74-49a6-9a82-f4e9ee390979', 'type': 'role_definition', 'uuid': '2adf1b51-96c0-483d-8a61-a16776d55b30'} 06/02/2025 02:08:04.160 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'pnf-servicechain-spine'] not found in DB: Unknown id: role_definition default-global-system-config:pnf-servicechain-spine 06/02/2025 02:08:04.165 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-servicechain-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-servicechain-spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:04.203 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'obj_dict': {'display_name': 'pnf-servicechain-spine', 'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'id_perms': {'created': '2025-06-02T02:08:04.181780', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:04.181780', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9249429231046512079, 'uuid_mslong': 11105496192150032274}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9a1ea5f2-838e-4f92-805c-92e14ba44dcf'}, 'oper': 'CREATE', 'request-id': 'req-af7722be-7038-443b-b7b3-c8bd10031e1d', 'type': 'role_definition', 'uuid': '9a1ea5f2-838e-4f92-805c-92e14ba44dcf'} 06/02/2025 02:08:04.301 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'pnf-servicechain-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:pnf-servicechain-leaf 06/02/2025 02:08:04.307 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = https://10.0.0.129:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-servicechain-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-servicechain-leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:04.340 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'obj_dict': {'display_name': 'pnf-servicechain-leaf', 'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'id_perms': {'created': '2025-06-02T02:08:04.323718', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:04.323718', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12317662008260719906, 'uuid_mslong': 8955139020417353797}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7c470b7e-2237-4845-aaf1-2055b1b47522'}, 'oper': 'CREATE', 'request-id': 'req-73b3e4cb-e832-441b-b1c3-b8ebae73170d', 'type': 'role_definition', 'uuid': '7c470b7e-2237-4845-aaf1-2055b1b47522'} 06/02/2025 02:08:04.431 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'erb-leaf', 'l3-gateway'] not found in DB: Unknown id: feature_config default-global-system-config:erb-leaf:l3-gateway 06/02/2025 02:08:04.438 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature_config identifier_name = default-global-system-config:erb-leaf:l3-gateway url = https://10.0.0.129:8082/feature-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature-config": {"uuid": null, "fq_name": ["default-global-system-config", "erb-leaf", "l3-gateway"], "parent_type": "role-definition", "feature_config_additional_params": {"key_value_pair": [{"key": "use_gateway_ip", "value": "True"}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "l3-gateway"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:04.463 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf', 'l3-gateway'], 'obj_dict': {'display_name': 'l3-gateway', 'feature_config_additional_params': {'key_value_pair': [{'key': 'use_gateway_ip', 'value': 'True'}]}, 'fq_name': ['default-global-system-config', 'erb-leaf', 'l3-gateway'], 'id_perms': {'created': '2025-06-02T02:08:04.450930', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:04.450930', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10243222940969955501, 'uuid_mslong': 14251000662786002229}}, 'parent_type': 'role-definition', 'parent_uuid': 'e937569b-4baf-44ef-bee1-576678d926f7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c5c5b999-0737-4d35-8e27-3cfe6fa570ad'}, 'oper': 'CREATE', 'request-id': 'req-d02471c8-a6ed-4971-8b3f-80bba92f0277', 'type': 'feature_config', 'uuid': 'c5c5b999-0737-4d35-8e27-3cfe6fa570ad'} 06/02/2025 02:08:04.560 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-client-spine', 'assisted-replicator'] not found in DB: Unknown id: feature_config default-global-system-config:ar-client-spine:assisted-replicator 06/02/2025 02:08:04.565 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature_config identifier_name = default-global-system-config:ar-client-spine:assisted-replicator url = https://10.0.0.129:8082/feature-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature-config": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client-spine", "assisted-replicator"], "parent_type": "role-definition", "feature_config_additional_params": {"key_value_pair": [{"key": "replicator_activation_delay", "value": "30"}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "assisted-replicator"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:04.588 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'feature_config_additional_params': {'key_value_pair': [{'key': 'replicator_activation_delay', 'value': '30'}]}, 'fq_name': ['default-global-system-config', 'ar-client-spine', 'assisted-replicator'], 'id_perms': {'created': '2025-06-02T02:08:04.578707', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:04.578707', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10975568973436674773, 'uuid_mslong': 4971421740690918799}}, 'parent_type': 'role-definition', 'parent_uuid': '29f273d7-ccb9-4f6e-bb2b-eb82717b2955', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '44fe09bb-c289-4d8f-9851-0dd48d7de2d5'}, 'oper': 'CREATE', 'request-id': 'req-60c0dc24-c76d-4759-83bc-3dbc3b558189', 'type': 'feature_config', 'uuid': '44fe09bb-c289-4d8f-9851-0dd48d7de2d5'} 06/02/2025 02:08:04.688 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-client-leaf', 'assisted-replicator'] not found in DB: Unknown id: feature_config default-global-system-config:ar-client-leaf:assisted-replicator 06/02/2025 02:08:04.693 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature_config identifier_name = default-global-system-config:ar-client-leaf:assisted-replicator url = https://10.0.0.129:8082/feature-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"feature-config": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client-leaf", "assisted-replicator"], "parent_type": "role-definition", "feature_config_additional_params": {"key_value_pair": [{"key": "replicator_activation_delay", "value": "30"}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "assisted-replicator"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:04.722 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'feature_config_additional_params': {'key_value_pair': [{'key': 'replicator_activation_delay', 'value': '30'}]}, 'fq_name': ['default-global-system-config', 'ar-client-leaf', 'assisted-replicator'], 'id_perms': {'created': '2025-06-02T02:08:04.708676', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:04.708676', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12103416641970487476, 'uuid_mslong': 1854940944156345922}}, 'parent_type': 'role-definition', 'parent_uuid': '824f6478-ad66-49c7-a1aa-271ca0100379', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '19be12f5-f7c4-4642-a7f7-f94f2933c0b4'}, 'oper': 'CREATE', 'request-id': 'req-967660ec-e639-4a4e-ad63-1eed331e189d', 'type': 'feature_config', 'uuid': '19be12f5-f7c4-4642-a7f7-f94f2933c0b4'} 06/02/2025 02:08:04.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:04.820 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5k-lean'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-qfx5k-lean 06/02/2025 02:08:04.826 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k-lean"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "Route-Reflector"]}, {"physical_role": "spine", "rb_roles": ["lean", "Route-Reflector"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5k-lean"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:04.850 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'obj_dict': {'display_name': 'juniper-qfx5k-lean', 'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'id_perms': {'created': '2025-06-02T02:08:04.841879', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:04.841879', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9575118711392937614, 'uuid_mslong': 6455052327791706795}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'Route-Reflector']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'}, 'oper': 'CREATE', 'request-id': 'req-3aea919e-83e8-4342-8e8a-685e233374bd', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:04.947 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5k'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-qfx5k 06/02/2025 02:08:04.955 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = https://10.0.0.129:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "ERB-UCAST-Gateway", "DCI-Gateway", "PNF-Servicechain", "AR-Client"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "DCI-Gateway", "PNF-Servicechain", "AR-Client"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5k"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:05.039 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'obj_dict': {'display_name': 'juniper-qfx5k', 'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'id_perms': {'created': '2025-06-02T02:08:05.025276', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:05.025276', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12503781153597724241, 'uuid_mslong': 13373056750381125621}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b996a442-cf9b-4ff5-ad86-5ab6196a9651'}, 'oper': 'CREATE', 'request-id': 'req-ed863730-a2e4-47a0-a553-183ddaa75ed7', 'type': 'node_profile', 'uuid': 'b996a442-cf9b-4ff5-ad86-5ab6196a9651'} 06/02/2025 02:08:05.130 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx10k-lean'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-qfx10k-lean 06/02/2025 02:08:05.136 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k-lean url = https://10.0.0.129:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k-lean"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["Route-Reflector", "AR-Client"]}, {"physical_role": "spine", "rb_roles": ["lean", "Route-Reflector", "AR-Client", "AR-Replicator"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10k-lean"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:05.169 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'obj_dict': {'display_name': 'juniper-qfx10k-lean', 'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'id_perms': {'created': '2025-06-02T02:08:05.153426', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:05.153426', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10116406215093964974, 'uuid_mslong': 16533587905333772356}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['Route-Reflector', 'AR-Client']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e5731a99-e81d-4044-8c64-b1da863ad0ae'}, 'oper': 'CREATE', 'request-id': 'req-82298de3-bfff-418a-a79f-74376c0970ac', 'type': 'node_profile', 'uuid': 'e5731a99-e81d-4044-8c64-b1da863ad0ae'} 06/02/2025 02:08:05.260 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5120'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-qfx5120 06/02/2025 02:08:05.265 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = https://10.0.0.129:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5120"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "Route-Reflector", "AR-Client", "ERB-UCAST-Gateway", "CRB-Gateway", "PNF-Servicechain"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Gateway", "Route-Reflector", "PNF-Servicechain", "Collapsed-Spine"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:05.296 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'obj_dict': {'display_name': 'juniper-qfx5120', 'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'id_perms': {'created': '2025-06-02T02:08:05.278580', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:05.278580', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10132249116098651528, 'uuid_mslong': 9374135881616540716}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'Route-Reflector', 'AR-Client', 'ERB-UCAST-Gateway', 'CRB-Gateway', 'PNF-Servicechain']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Gateway', 'Route-Reflector', 'PNF-Servicechain', 'Collapsed-Spine']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '82179eeb-03ff-442c-8c9c-fae35cd36588'}, 'oper': 'CREATE', 'request-id': 'req-bb467934-b3da-43f5-ae66-45357847dfa7', 'type': 'node_profile', 'uuid': '82179eeb-03ff-442c-8c9c-fae35cd36588'} 06/02/2025 02:08:05.384 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5220'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-qfx5220 06/02/2025 02:08:05.392 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5220 url = https://10.0.0.129:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5220"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "spine", "rb_roles": ["lean", "Route-Reflector"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5220"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:05.426 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'obj_dict': {'display_name': 'juniper-qfx5220', 'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'id_perms': {'created': '2025-06-02T02:08:05.409357', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:05.409357', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11524400215339160640, 'uuid_mslong': 4027116725390099614}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '37e33153-3de9-449e-9fee-e4efdcb9d440'}, 'oper': 'CREATE', 'request-id': 'req-411f4fe6-da87-48fa-9855-37dc0fd79bb9', 'type': 'node_profile', 'uuid': '37e33153-3de9-449e-9fee-e4efdcb9d440'} 06/02/2025 02:08:05.515 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx10k'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-qfx10k 06/02/2025 02:08:05.520 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.129:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "ERB-UCAST-Gateway", "DCI-Gateway", "CRB-MCAST-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "CRB-MCAST-Gateway", "DCI-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator", "Collapsed-Spine"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10k"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:05.559 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'obj_dict': {'display_name': 'juniper-qfx10k', 'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'id_perms': {'created': '2025-06-02T02:08:05.547394', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:05.547394', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11333908068922346169, 'uuid_mslong': 16696509635267284310}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'CRB-MCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator', 'Collapsed-Spine']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9'}, 'oper': 'CREATE', 'request-id': 'req-be51f7ce-359f-4364-81e9-a6a269b63783', 'type': 'node_profile', 'uuid': 'e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9'} 06/02/2025 02:08:05.656 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-mx'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-mx 06/02/2025 02:08:05.694 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-mx"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Gateway", "DC-Gateway", "Route-Reflector", "DCI-Gateway", "ERB-UCAST-Gateway", "DCI-Gateway", "CRB-MCAST-Gateway"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "CRB-MCAST-Gateway", "DCI-Gateway"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:05.765 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'obj_dict': {'display_name': 'juniper-mx', 'fq_name': ['default-global-system-config', 'juniper-mx'], 'id_perms': {'created': '2025-06-02T02:08:05.759089', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:05.759089', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9892970774611474249, 'uuid_mslong': 2151096072368770260}}, 'node_profile_device_family': 'junos', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'CRB-MCAST-Gateway']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'}, 'oper': 'CREATE', 'request-id': 'req-0262d806-3780-4054-ad31-2d36c9301bd0', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:05.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:05.864 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-srx'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-srx 06/02/2025 02:08:05.869 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.129:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-srx"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos", "node_profile_hitless_upgrade": false, "node_profile_roles": {"role_mappings": [{"physical_role": "pnf", "rb_roles": ["PNF-Servicechain"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:05.909 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'obj_dict': {'display_name': 'juniper-srx', 'fq_name': ['default-global-system-config', 'juniper-srx'], 'id_perms': {'created': '2025-06-02T02:08:05.890304', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:05.890304', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13414681238542145935, 'uuid_mslong': 11752802126577552808}}, 'node_profile_device_family': 'junos', 'node_profile_hitless_upgrade': False, 'node_profile_roles': {'role_mappings': [{'physical_role': 'pnf', 'rb_roles': ['PNF-Servicechain']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a31a5743-de1c-4da8-ba2a-85832e66d98f'}, 'oper': 'CREATE', 'request-id': 'req-dffab9e9-b279-4fa9-a7b8-0cc694611add', 'type': 'node_profile', 'uuid': 'a31a5743-de1c-4da8-ba2a-85832e66d98f'} 06/02/2025 02:08:06.005 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'device-functional-group'] not found in DB: Unknown id: node_profile default-global-system-config:device-functional-group 06/02/2025 02:08:06.013 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:device-functional-group url = https://10.0.0.129:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "device-functional-group"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "DCI-Gateway", "ERB-UCAST-Gateway", "CRB-MCAST-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "CRB-MCAST-Gateway", "DCI-Gateway", "ERB-UCAST-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "device-functional-group"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:06.047 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'device-functional-group'], 'obj_dict': {'display_name': 'device-functional-group', 'fq_name': ['default-global-system-config', 'device-functional-group'], 'id_perms': {'created': '2025-06-02T02:08:06.028404', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:06.028404', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9968882827474982524, 'uuid_mslong': 1181223004503230935}}, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'CRB-MCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '10648c10-6fef-49d7-8a58-961d3b23567c'}, 'oper': 'CREATE', 'request-id': 'req-b7e1bea4-235f-4b36-9159-3832368b90bf', 'type': 'node_profile', 'uuid': '10648c10-6fef-49d7-8a58-961d3b23567c'} 06/02/2025 02:08:06.139 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'default-telemetry-profile-1'] not found in DB: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-1 06/02/2025 02:08:06.143 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-1 url = https://10.0.0.129:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-1"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:06.223 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'obj_dict': {'display_name': 'default-telemetry-profile-1', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'id_perms': {'created': '2025-06-02T02:08:06.163804', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:06.163804', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12367159217945591756, 'uuid_mslong': 15442557317339694869}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': 'd64efc0f-dba4-4715-aba0-f9c8e2583fcc'}, 'oper': 'CREATE', 'request-id': 'req-8431b29b-283d-4659-801a-396f90e2fd85', 'type': 'telemetry_profile', 'uuid': 'd64efc0f-dba4-4715-aba0-f9c8e2583fcc'} 06/02/2025 02:08:06.262 7fad85601438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:06.316 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'default-telemetry-profile-2'] not found in DB: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-2 06/02/2025 02:08:06.322 7fad8582da20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-2 url = https://10.0.0.129:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-2"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-2"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:06.322 7fad8582da20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-2 url = https://10.0.0.129:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-2"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-2"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:06.347 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'obj_dict': {'display_name': 'default-telemetry-profile-2', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'id_perms': {'created': '2025-06-02T02:08:06.336907', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:06.336907', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10943202868335412060, 'uuid_mslong': 12055125387595956537}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': 'a74c68ab-5273-4139-97de-1107782b035c'}, 'oper': 'CREATE', 'request-id': 'req-b6897ec2-9d09-4835-8c4c-d66eae3ebee7', 'type': 'telemetry_profile', 'uuid': 'a74c68ab-5273-4139-97de-1107782b035c'} 06/02/2025 02:08:06.450 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'default-telemetry-profile-3'] not found in DB: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-3 06/02/2025 02:08:06.457 7fad854676d8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-3 url = https://10.0.0.129:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-3"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-3"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:06.457 7fad854676d8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-3 url = https://10.0.0.129:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-3"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-3"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:06.480 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'obj_dict': {'display_name': 'default-telemetry-profile-3', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'id_perms': {'created': '2025-06-02T02:08:06.472744', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:06.472744', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9615343415020300870, 'uuid_mslong': 16602711534837317671}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': 'e668ae2d-0e42-4027-8570-8fe445ad2a46'}, 'oper': 'CREATE', 'request-id': 'req-d3eaa4a1-f296-4b9f-abde-378d32309440', 'type': 'telemetry_profile', 'uuid': 'e668ae2d-0e42-4027-8570-8fe445ad2a46'} 06/02/2025 02:08:06.580 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'default-telemetry-profile-4'] not found in DB: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-4 06/02/2025 02:08:06.585 7fad8520f588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-4 url = https://10.0.0.129:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-4"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-4"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:06.585 7fad8520f588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-4 url = https://10.0.0.129:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-4"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-4"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:06.676 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'obj_dict': {'display_name': 'default-telemetry-profile-4', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'id_perms': {'created': '2025-06-02T02:08:06.669002', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:06.669002', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11318813910204546860, 'uuid_mslong': 10153627918091895197}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '8ce8eecb-975b-419d-9d14-81481c7dff2c'}, 'oper': 'CREATE', 'request-id': 'req-fa50aec8-4dbd-4515-9373-a04f049d92c4', 'type': 'telemetry_profile', 'uuid': '8ce8eecb-975b-419d-9d14-81481c7dff2c'} 06/02/2025 02:08:06.775 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'default-telemetry-profile-5'] not found in DB: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-5 06/02/2025 02:08:06.780 7fad8534f630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-5 url = https://10.0.0.129:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-5"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-5"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:06.780 7fad8534f630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-5 url = https://10.0.0.129:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-5"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-5"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:06.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:06.805 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'obj_dict': {'display_name': 'default-telemetry-profile-5', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'id_perms': {'created': '2025-06-02T02:08:06.798426', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:06.798426', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12365089896878996617, 'uuid_mslong': 6568285294988902993}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '5b273cac-ef3c-4251-ab99-9fbf873e7c89'}, 'oper': 'CREATE', 'request-id': 'req-9642a7c1-f29b-4e83-8d57-d10858763559', 'type': 'telemetry_profile', 'uuid': '5b273cac-ef3c-4251-ab99-9fbf873e7c89'} 06/02/2025 02:08:06.909 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'default-telemetry-profile-6'] not found in DB: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-6 06/02/2025 02:08:06.919 7fad853ba0f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-6 url = https://10.0.0.129:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-6"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-6"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:06.920 7fad853ba0f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-6 url = https://10.0.0.129:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-6"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-6"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:06.952 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'obj_dict': {'display_name': 'default-telemetry-profile-6', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'id_perms': {'created': '2025-06-02T02:08:06.943054', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:06.943054', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12047981524622389949, 'uuid_mslong': 7364585780334317206}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '663443bf-7ab8-4e96-a733-075d1b9632bd'}, 'oper': 'CREATE', 'request-id': 'req-0b94b6e9-76c7-4557-94ae-c7e0f9f169a1', 'type': 'telemetry_profile', 'uuid': '663443bf-7ab8-4e96-a733-075d1b9632bd'} 06/02/2025 02:08:07.057 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'sflow-all-interfaces'] not found in DB: Unknown id: sflow_profile default-domain:default-project:sflow-all-interfaces 06/02/2025 02:08:07.063 7fad855692e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = sflow_profile identifier_name = default-domain:default-project:sflow-all-interfaces url = https://10.0.0.129:8082/sflow-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"sflow-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "sflow-all-interfaces"], "parent_type": "project", "sflow_profile_is_default": true, "sflow_parameters": {"stats_collection_frequency": {"sample_rate": 2000, "polling_interval": 0, "direction": null}, "agent_id": null, "adaptive_sample_rate": 300, "enabled_interface_type": "all", "enabled_interface_params": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "sflow-all-interfaces"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:07.063 7fad855692e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = sflow_profile identifier_name = default-domain:default-project:sflow-all-interfaces url = https://10.0.0.129:8082/sflow-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"sflow-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "sflow-all-interfaces"], "parent_type": "project", "sflow_profile_is_default": true, "sflow_parameters": {"stats_collection_frequency": {"sample_rate": 2000, "polling_interval": 0, "direction": null}, "agent_id": null, "adaptive_sample_rate": 300, "enabled_interface_type": "all", "enabled_interface_params": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "sflow-all-interfaces"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:07.098 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-all-interfaces'], 'obj_dict': {'display_name': 'sflow-all-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-all-interfaces'], 'id_perms': {'created': '2025-06-02T02:08:07.082748', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:07.082748', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9980518455046773243, 'uuid_mslong': 15617387119719040694}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'all', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': 'd8bc1ad7-469d-46b6-8a81-eca7e34b19fb'}, 'oper': 'CREATE', 'request-id': 'req-736d3273-3e84-4c61-a138-790e35aaa73c', 'type': 'sflow_profile', 'uuid': 'd8bc1ad7-469d-46b6-8a81-eca7e34b19fb'} 06/02/2025 02:08:07.186 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'sflow-fabric-interfaces'] not found in DB: Unknown id: sflow_profile default-domain:default-project:sflow-fabric-interfaces 06/02/2025 02:08:07.193 7fad853b3eb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = sflow_profile identifier_name = default-domain:default-project:sflow-fabric-interfaces url = https://10.0.0.129:8082/sflow-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"sflow-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "sflow-fabric-interfaces"], "parent_type": "project", "sflow_profile_is_default": true, "sflow_parameters": {"stats_collection_frequency": {"sample_rate": 2000, "polling_interval": 0, "direction": null}, "agent_id": null, "adaptive_sample_rate": 300, "enabled_interface_type": "fabric", "enabled_interface_params": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "sflow-fabric-interfaces"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:07.194 7fad853b3eb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = sflow_profile identifier_name = default-domain:default-project:sflow-fabric-interfaces url = https://10.0.0.129:8082/sflow-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"sflow-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "sflow-fabric-interfaces"], "parent_type": "project", "sflow_profile_is_default": true, "sflow_parameters": {"stats_collection_frequency": {"sample_rate": 2000, "polling_interval": 0, "direction": null}, "agent_id": null, "adaptive_sample_rate": 300, "enabled_interface_type": "fabric", "enabled_interface_params": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "sflow-fabric-interfaces"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:07.230 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-fabric-interfaces'], 'obj_dict': {'display_name': 'sflow-fabric-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-fabric-interfaces'], 'id_perms': {'created': '2025-06-02T02:08:07.210095', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:07.210095', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9233411374734387163, 'uuid_mslong': 15979043297147964645}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'fabric', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': 'ddc0f737-d917-4ce5-8023-aab9801827db'}, 'oper': 'CREATE', 'request-id': 'req-6203d502-00ac-40d7-a370-4a88c89c1d00', 'type': 'sflow_profile', 'uuid': 'ddc0f737-d917-4ce5-8023-aab9801827db'} 06/02/2025 02:08:07.318 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'sflow-access-interfaces'] not found in DB: Unknown id: sflow_profile default-domain:default-project:sflow-access-interfaces 06/02/2025 02:08:07.325 7fad85564438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = sflow_profile identifier_name = default-domain:default-project:sflow-access-interfaces url = https://10.0.0.129:8082/sflow-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"sflow-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "sflow-access-interfaces"], "parent_type": "project", "sflow_profile_is_default": true, "sflow_parameters": {"stats_collection_frequency": {"sample_rate": 2000, "polling_interval": 0, "direction": null}, "agent_id": null, "adaptive_sample_rate": 300, "enabled_interface_type": "access", "enabled_interface_params": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "sflow-access-interfaces"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:07.326 7fad85564438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = sflow_profile identifier_name = default-domain:default-project:sflow-access-interfaces url = https://10.0.0.129:8082/sflow-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"sflow-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "sflow-access-interfaces"], "parent_type": "project", "sflow_profile_is_default": true, "sflow_parameters": {"stats_collection_frequency": {"sample_rate": 2000, "polling_interval": 0, "direction": null}, "agent_id": null, "adaptive_sample_rate": 300, "enabled_interface_type": "access", "enabled_interface_params": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "sflow-access-interfaces"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:07.369 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-access-interfaces'], 'obj_dict': {'display_name': 'sflow-access-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-access-interfaces'], 'id_perms': {'created': '2025-06-02T02:08:07.350200', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:07.350200', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10429767826850504424, 'uuid_mslong': 16410153620776697864}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'access', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': 'e3bc93c5-fbfc-4008-90bd-fa944938dee8'}, 'oper': 'CREATE', 'request-id': 'req-1d7f704a-42fd-42ea-8e2b-4b7f6b12f3dd', 'type': 'sflow_profile', 'uuid': 'e3bc93c5-fbfc-4008-90bd-fa944938dee8'} 06/02/2025 02:08:07.456 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'grpc-default-profile'] not found in DB: Unknown id: grpc_profile default-domain:default-project:grpc-default-profile 06/02/2025 02:08:07.511 7fad852dc240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = grpc_profile identifier_name = default-domain:default-project:grpc-default-profile url = https://10.0.0.129:8082/grpc-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"grpc-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "grpc-default-profile"], "parent_type": "project", "grpc_profile_is_default": true, "grpc_parameters": {"allow_clients": {"subnet": [{"ip_prefix": "0.0.0.0", "ip_prefix_len": 0}]}, "enabled_sensor_params": {"physical_health": true, "interface_health": true, "control_plane_health": true, "service_layer_health": true}, "secure_mode": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "grpc-default-profile"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:07.516 7fad852dc240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = grpc_profile identifier_name = default-domain:default-project:grpc-default-profile url = https://10.0.0.129:8082/grpc-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"grpc-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "grpc-default-profile"], "parent_type": "project", "grpc_profile_is_default": true, "grpc_parameters": {"allow_clients": {"subnet": [{"ip_prefix": "0.0.0.0", "ip_prefix_len": 0}]}, "enabled_sensor_params": {"physical_health": true, "interface_health": true, "control_plane_health": true, "service_layer_health": true}, "secure_mode": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "grpc-default-profile"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:07.601 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'grpc-default-profile'], 'obj_dict': {'display_name': 'grpc-default-profile', 'fq_name': ['default-domain', 'default-project', 'grpc-default-profile'], 'grpc_parameters': {'allow_clients': {'subnet': [{'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}]}, 'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}, 'secure_mode': None}, 'grpc_profile_is_default': True, 'id_perms': {'created': '2025-06-02T02:08:07.555667', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:07.555667', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11394631282366088550, 'uuid_mslong': 25944940396693882}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '005c2cc9-2c10-497a-9e21-dcc7abfc0566'}, 'oper': 'CREATE', 'request-id': 'req-956ed2e8-fa36-44c7-9fa5-2f36f35186b4', 'type': 'grpc_profile', 'uuid': '005c2cc9-2c10-497a-9e21-dcc7abfc0566'} 06/02/2025 02:08:07.705 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'snmp-default-profile'] not found in DB: Unknown id: snmp_profile default-domain:default-project:snmp-default-profile 06/02/2025 02:08:07.713 7fad855ca8d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = snmp_profile identifier_name = default-domain:default-project:snmp-default-profile url = https://10.0.0.129:8082/snmp-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"snmp-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "snmp-default-profile"], "parent_type": "project", "snmp_profile_is_default": true, "snmp_parameters": {"enabled_sensor_params": {"physical_health": true, "interface_health": true, "control_plane_health": true, "service_layer_health": true}}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "snmp-default-profile"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:07.714 7fad855ca8d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = snmp_profile identifier_name = default-domain:default-project:snmp-default-profile url = https://10.0.0.129:8082/snmp-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"snmp-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "snmp-default-profile"], "parent_type": "project", "snmp_profile_is_default": true, "snmp_parameters": {"enabled_sensor_params": {"physical_health": true, "interface_health": true, "control_plane_health": true, "service_layer_health": true}}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "snmp-default-profile"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:07.751 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'snmp-default-profile'], 'obj_dict': {'display_name': 'snmp-default-profile', 'fq_name': ['default-domain', 'default-project', 'snmp-default-profile'], 'id_perms': {'created': '2025-06-02T02:08:07.726457', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:07.726457', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12226959726594977841, 'uuid_mslong': 7472592679838043258}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'snmp_parameters': {'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}}, 'snmp_profile_is_default': True, 'uuid': '67b3fb73-68ee-4c7a-a9ae-e31712b37031'}, 'oper': 'CREATE', 'request-id': 'req-dac352f7-cc5b-4257-8e9a-b54f3637cb1b', 'type': 'snmp_profile', 'uuid': '67b3fb73-68ee-4c7a-a9ae-e31712b37031'} 06/02/2025 02:08:07.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:07.852 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'netconf-default-profile'] not found in DB: Unknown id: netconf_profile default-domain:default-project:netconf-default-profile 06/02/2025 02:08:07.858 7fad85c64588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = netconf_profile identifier_name = default-domain:default-project:netconf-default-profile url = https://10.0.0.129:8082/netconf-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"netconf-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "netconf-default-profile"], "parent_type": "project", "netconf_profile_is_default": true, "netconf_parameters": {"enabled_sensor_params": {"physical_health": true, "interface_health": true, "control_plane_health": true, "service_layer_health": true}}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "netconf-default-profile"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:07.858 7fad85c64588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = netconf_profile identifier_name = default-domain:default-project:netconf-default-profile url = https://10.0.0.129:8082/netconf-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"netconf-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "netconf-default-profile"], "parent_type": "project", "netconf_profile_is_default": true, "netconf_parameters": {"enabled_sensor_params": {"physical_health": true, "interface_health": true, "control_plane_health": true, "service_layer_health": true}}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "netconf-default-profile"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:07.884 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'netconf-default-profile'], 'obj_dict': {'display_name': 'netconf-default-profile', 'fq_name': ['default-domain', 'default-project', 'netconf-default-profile'], 'id_perms': {'created': '2025-06-02T02:08:07.873046', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:07.873046', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12359245302144051231, 'uuid_mslong': 9657864762560105872}}, 'netconf_parameters': {'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}}, 'netconf_profile_is_default': True, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8607a0d4-fd28-4d90-ab84-dc1ec636281f'}, 'oper': 'CREATE', 'request-id': 'req-63a888d9-cb52-4dce-b23d-fe4a553d4772', 'type': 'netconf_profile', 'uuid': '8607a0d4-fd28-4d90-ab84-dc1ec636281f'} 06/02/2025 02:08:07.974 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'L2-Server-Leaf'] not found in DB: Unknown id: device_functional_group default-domain:default-project:L2-Server-Leaf 06/02/2025 02:08:07.979 7fad8583bcc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L2-Server-Leaf url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L2-Server-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L2 servers connectivity with ingress replication for multicast in the spine", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["CRB-Access", "AR-Client"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L2-Server-Leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:07.979 7fad8583bcc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L2-Server-Leaf url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L2-Server-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L2 servers connectivity with ingress replication for multicast in the spine", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["CRB-Access", "AR-Client"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L2-Server-Leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:07.996 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L2 servers ' 'connectivity with ' 'ingress replication for ' 'multicast in the spine', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['CRB-Access', 'AR-Client']}, 'display_name': 'L2-Server-Leaf', 'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'id_perms': {'created': '2025-06-02T02:08:07.989247', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:07.989247', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10672054838415520572, 'uuid_mslong': 8149500580313450360}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7118d799-926c-4778-941a-c155233ef33c'}, 'oper': 'CREATE', 'request-id': 'req-82d2055b-adeb-4c84-8348-3f3447fd8ec1', 'type': 'device_functional_group', 'uuid': '7118d799-926c-4778-941a-c155233ef33c'} 06/02/2025 02:08:08.098 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'L3-Server-Leaf'] not found in DB: Unknown id: device_functional_group default-domain:default-project:L3-Server-Leaf 06/02/2025 02:08:08.106 7fad855c7588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Server-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L3 servers connectivity", "device_functional_group_os_version": "19.1R3", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Server-Leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:08.107 7fad855c7588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Server-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L3 servers connectivity", "device_functional_group_os_version": "19.1R3", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Server-Leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:08.139 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L3 servers ' 'connectivity', 'device_functional_group_os_version': '19.1R3', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway']}, 'display_name': 'L3-Server-Leaf', 'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'id_perms': {'created': '2025-06-02T02:08:08.121691', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:08.121691', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9437496054193142412, 'uuid_mslong': 15061629075056444631}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd105a7d8-056f-44d7-82f8-b8a8c7553a8c'}, 'oper': 'CREATE', 'request-id': 'req-f34c50a2-da8b-4793-bfac-317f15d6696d', 'type': 'device_functional_group', 'uuid': 'd105a7d8-056f-44d7-82f8-b8a8c7553a8c'} 06/02/2025 02:08:08.227 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'L3-Gateway-Spine'] not found in DB: Unknown id: device_functional_group default-domain:default-project:L3-Gateway-Spine 06/02/2025 02:08:08.233 7fad8520f240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Gateway-Spine url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Gateway-Spine"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway connectivity at spines", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["CRB-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Gateway-Spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:08.233 7fad8520f240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Gateway-Spine url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Gateway-Spine"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway connectivity at spines", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["CRB-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Gateway-Spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:08.256 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'connectivity at spines', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['CRB-Gateway']}, 'display_name': 'L3-Gateway-Spine', 'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'id_perms': {'created': '2025-06-02T02:08:08.249046', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:08.249046', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9405185584904659536, 'uuid_mslong': 5461991351611508631}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4bcce432-070f-4797-8285-ee756adde250'}, 'oper': 'CREATE', 'request-id': 'req-14674ab6-03a2-4cd3-a287-2fa11b21a7e6', 'type': 'device_functional_group', 'uuid': '4bcce432-070f-4797-8285-ee756adde250'} 06/02/2025 02:08:08.356 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'L3-Storage-Leaf'] not found in DB: Unknown id: device_functional_group default-domain:default-project:L3-Storage-Leaf 06/02/2025 02:08:08.361 7fad854480f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Storage-Leaf url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Storage-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L3 connectivity to storage arrays", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Storage-Leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:08.361 7fad854480f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Storage-Leaf url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Storage-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L3 connectivity to storage arrays", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Storage-Leaf"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:08.384 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L3 connectivity ' 'to storage arrays', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway']}, 'display_name': 'L3-Storage-Leaf', 'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'id_perms': {'created': '2025-06-02T02:08:08.375142', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:08.375142', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13056641538561614913, 'uuid_mslong': 10369198013628960095}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8fe6caa7-b00a-4d5f-b532-824d61932441'}, 'oper': 'CREATE', 'request-id': 'req-25878d12-0a3c-4df0-97d7-995abe32517b', 'type': 'device_functional_group', 'uuid': '8fe6caa7-b00a-4d5f-b532-824d61932441'} 06/02/2025 02:08:08.479 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'] not found in DB: Unknown id: device_functional_group default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast 06/02/2025 02:08:08.485 7fad86204588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Server-Leaf-with-Optimized-Multicast"], "parent_type": "project", "device_functional_group_description": "Provides L3 servers connectivity with Optimized multicast traffic", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway", "AR-Client"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Server-Leaf-with-Optimized-Multicast"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:08.486 7fad86204588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Server-Leaf-with-Optimized-Multicast"], "parent_type": "project", "device_functional_group_description": "Provides L3 servers connectivity with Optimized multicast traffic", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway", "AR-Client"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Server-Leaf-with-Optimized-Multicast"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:08.505 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'obj_dict': {'device_functional_group_description': 'Provides L3 servers ' 'connectivity with ' 'Optimized multicast ' 'traffic', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway', 'AR-Client']}, 'display_name': 'L3-Server-Leaf-with-Optimized-Multicast', 'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'id_perms': {'created': '2025-06-02T02:08:08.497924', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:08.497924', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10561868125079255726, 'uuid_mslong': 2241359573263599981}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1f1ae8a8-1a4c-496d-9293-4b19bfdebaae'}, 'oper': 'CREATE', 'request-id': 'req-f4c40294-238a-4b2e-bbfd-d1c00520dd17', 'type': 'device_functional_group', 'uuid': '1f1ae8a8-1a4c-496d-9293-4b19bfdebaae'} 06/02/2025 02:08:08.604 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'] not found in DB: Unknown id: device_functional_group default-domain:default-project:Centrally-Routed-Border-Spine 06/02/2025 02:08:08.617 7fad85620eb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Centrally-Routed-Border-Spine"], "parent_type": "project", "device_functional_group_description": "Provides L3 routing for L2 server leafs and route reflector and ingress replication, as well DCGW and DCI GW and connectivity to firewalls", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "CRB-Gateway", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Centrally-Routed-Border-Spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:08.617 7fad85620eb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Centrally-Routed-Border-Spine"], "parent_type": "project", "device_functional_group_description": "Provides L3 routing for L2 server leafs and route reflector and ingress replication, as well DCGW and DCI GW and connectivity to firewalls", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "CRB-Gateway", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Centrally-Routed-Border-Spine"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:08.650 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'obj_dict': {'device_functional_group_description': 'Provides L3 routing ' 'for L2 server leafs and ' 'route reflector and ' 'ingress replication, as ' 'well DCGW and DCI GW and ' 'connectivity to ' 'firewalls', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'CRB-Gateway', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain']}, 'display_name': 'Centrally-Routed-Border-Spine', 'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'id_perms': {'created': '2025-06-02T02:08:08.634007', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:08.634007', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13787180984812113077, 'uuid_mslong': 2217180768247171193}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1ec50229-5e33-4879-bf55-e80eddbf0cb5'}, 'oper': 'CREATE', 'request-id': 'req-11e4622a-452e-438b-bdc2-e07a7b67a2f0', 'type': 'device_functional_group', 'uuid': '1ec50229-5e33-4879-bf55-e80eddbf0cb5'} 06/02/2025 02:08:08.744 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'] not found in DB: Unknown id: device_functional_group default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast 06/02/2025 02:08:08.756 7fad854afc18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Centrally-Routed-Border-Spine-With-Optimized-Multicast"], "parent_type": "project", "device_functional_group_description": "Provides L3 routing and gateway services for L2 server leafs ; provides route reflector and assisted replication", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "AR-Replicator", "CRB-Gateway", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Centrally-Routed-Border-Spine-With-Optimized-Multicast"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:08.756 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Centrally-Routed-Border-Spine-With-Optimized-Multicast"], "parent_type": "project", "device_functional_group_description": "Provides L3 routing and gateway services for L2 server leafs ; provides route reflector and assisted replication", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "AR-Replicator", "CRB-Gateway", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Centrally-Routed-Border-Spine-With-Optimized-Multicast"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:08.789 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'obj_dict': {'device_functional_group_description': 'Provides L3 routing and ' 'gateway services for L2 ' 'server leafs ; provides ' 'route reflector and ' 'assisted replication', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'AR-Replicator', 'CRB-Gateway', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain']}, 'display_name': 'Centrally-Routed-Border-Spine-With-Optimized-Multicast', 'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'id_perms': {'created': '2025-06-02T02:08:08.773854', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:08.773854', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9560718799886600101, 'uuid_mslong': 14106919185736680933}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c3c5d841-fcfa-45e5-84ae-7f17f8a3c7a5'}, 'oper': 'CREATE', 'request-id': 'req-25d95bea-c765-4aaa-ba1d-0ab51ed4cf0a', 'type': 'device_functional_group', 'uuid': 'c3c5d841-fcfa-45e5-84ae-7f17f8a3c7a5'} 06/02/2025 02:08:08.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:08.880 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'] not found in DB: Unknown id: device_functional_group default-domain:default-project:Border-Spine-in-Edge-Routed 06/02/2025 02:08:08.886 7fad855ca780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Border-Spine-in-Edge-Routed url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Border-Spine-in-Edge-Routed"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway services, route reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain", "CRB-MCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Border-Spine-in-Edge-Routed"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:08.887 7fad855ca780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Border-Spine-in-Edge-Routed url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Border-Spine-in-Edge-Routed"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway services, route reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain", "CRB-MCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Border-Spine-in-Edge-Routed"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:08.924 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'services, route ' 'reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'CRB-MCAST-Gateway']}, 'display_name': 'Border-Spine-in-Edge-Routed', 'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'id_perms': {'created': '2025-06-02T02:08:08.916050', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:08.916050', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10173509210947023096, 'uuid_mslong': 1739224219216137390}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1822f736-6b22-4cae-8d2f-90b9cda970f8'}, 'oper': 'CREATE', 'request-id': 'req-a01e3dc1-a6d6-4b62-ad82-121a567eb917', 'type': 'device_functional_group', 'uuid': '1822f736-6b22-4cae-8d2f-90b9cda970f8'} 06/02/2025 02:08:09.019 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'] not found in DB: Unknown id: device_functional_group default-domain:default-project:Border-Leaf-in-Edge-Routed 06/02/2025 02:08:09.025 7fad86931b70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Border-Leaf-in-Edge-Routed url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Border-Leaf-in-Edge-Routed"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway services, route reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain", "CRB-MCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Border-Leaf-in-Edge-Routed"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.025 7fad86931b70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Border-Leaf-in-Edge-Routed url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Border-Leaf-in-Edge-Routed"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway services, route reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain", "CRB-MCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Border-Leaf-in-Edge-Routed"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.045 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'services, route ' 'reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'CRB-MCAST-Gateway']}, 'display_name': 'Border-Leaf-in-Edge-Routed', 'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'id_perms': {'created': '2025-06-02T02:08:09.036854', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:09.036854', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13758426991075423496, 'uuid_mslong': 8265640097192101349}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '72b573e0-0a5c-45e5-beef-c073ff327508'}, 'oper': 'CREATE', 'request-id': 'req-a3856c2b-958d-463e-a90e-27757835b277', 'type': 'device_functional_group', 'uuid': '72b573e0-0a5c-45e5-beef-c073ff327508'} 06/02/2025 02:08:09.145 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'] not found in DB: Unknown id: device_functional_group default-domain:default-project:Lean-Spine-with-Route-Reflector 06/02/2025 02:08:09.151 7fad853da198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Lean-Spine-with-Route-Reflector url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Lean-Spine-with-Route-Reflector"], "parent_type": "project", "device_functional_group_description": "Spine only acting as Route Reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "lean"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Lean-Spine-with-Route-Reflector"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.151 7fad853da198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Lean-Spine-with-Route-Reflector url = https://10.0.0.129:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Lean-Spine-with-Route-Reflector"], "parent_type": "project", "device_functional_group_description": "Spine only acting as Route Reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "lean"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Lean-Spine-with-Route-Reflector"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.186 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'obj_dict': {'device_functional_group_description': 'Spine only acting as ' 'Route Reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'lean']}, 'display_name': 'Lean-Spine-with-Route-Reflector', 'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'id_perms': {'created': '2025-06-02T02:08:09.163914', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:09.163914', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10480677870790104197, 'uuid_mslong': 2342684578946369655}}, 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2082e336-64e2-4877-9172-d8fe95bdd485'}, 'oper': 'CREATE', 'request-id': 'req-414e8b06-d41a-4ebd-bb6b-98f30518b22a', 'type': 'device_functional_group', 'uuid': '2082e336-64e2-4877-9172-d8fe95bdd485'} 06/02/2025 02:08:09.268 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5k-lean', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-qfx5k-lean:basic 06/02/2025 02:08:09.277 7fad86255630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5k-lean:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k-lean", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.277 7fad86255630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5k-lean:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k-lean", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.305 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean', 'basic'], 'id_perms': {'created': '2025-06-02T02:08:09.294914', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:09.294914', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11145802824499601586, 'uuid_mslong': 4148313284997627973}}, 'parent_type': 'node-profile', 'parent_uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '3991c4f4-3951-4045-9aad-d89daad820b2'}, 'oper': 'CREATE', 'request-id': 'req-d4c527cd-c65b-40dd-a5d3-d35543b41d69', 'type': 'role_config', 'uuid': '3991c4f4-3951-4045-9aad-d89daad820b2'} 06/02/2025 02:08:09.399 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5k', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-qfx5k:basic 06/02/2025 02:08:09.404 7fad855ea198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5k:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.404 7fad855ea198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5k:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.429 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5k', 'basic'], 'id_perms': {'created': '2025-06-02T02:08:09.416588', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:09.416588', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12413495713510606637, 'uuid_mslong': 8659398535319799438}}, 'parent_type': 'node-profile', 'parent_uuid': 'b996a442-cf9b-4ff5-ad86-5ab6196a9651', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '782c5d16-a246-468e-ac45-9894f8a2472d'}, 'oper': 'CREATE', 'request-id': 'req-c2889708-2a76-4e59-a1d4-d545c994658c', 'type': 'role_config', 'uuid': '782c5d16-a246-468e-ac45-9894f8a2472d'} 06/02/2025 02:08:09.524 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5120', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-qfx5120:basic 06/02/2025 02:08:09.531 7fad85604828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5120:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5120", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.531 7fad85604828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5120:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5120", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.561 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5120', 'basic'], 'id_perms': {'created': '2025-06-02T02:08:09.551079', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:09.551079', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11024580947604262352, 'uuid_mslong': 15961091184841540422}}, 'parent_type': 'node-profile', 'parent_uuid': '82179eeb-03ff-442c-8c9c-fae35cd36588', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': 'dd812fdd-fc19-4346-98ff-2df60b7dcdd0'}, 'oper': 'CREATE', 'request-id': 'req-103511a3-777c-4f6b-a9ec-27e9df46a736', 'type': 'role_config', 'uuid': 'dd812fdd-fc19-4346-98ff-2df60b7dcdd0'} 06/02/2025 02:08:09.659 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5220', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-qfx5220:basic 06/02/2025 02:08:09.665 7fad86dba978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5220:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5220", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.666 7fad86dba978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5220:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5220", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.692 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5220', 'basic'], 'id_perms': {'created': '2025-06-02T02:08:09.676477', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:09.676477', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12800056110355602043, 'uuid_mslong': 11242615216659843837}}, 'parent_type': 'node-profile', 'parent_uuid': '37e33153-3de9-449e-9fee-e4efdcb9d440', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '9c05caf9-3f69-4afd-b1a2-ef36fad05a7b'}, 'oper': 'CREATE', 'request-id': 'req-e2617076-e9a3-4e40-95f1-9c22a2d8a293', 'type': 'role_config', 'uuid': '9c05caf9-3f69-4afd-b1a2-ef36fad05a7b'} 06/02/2025 02:08:09.768 7fad868c0e10 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:08:09.780 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx10k-lean', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-qfx10k-lean:basic 06/02/2025 02:08:09.788 7fad853ca630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx10k-lean:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k-lean", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.788 7fad853ca630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx10k-lean:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k-lean", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:09.809 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean', 'basic'], 'id_perms': {'created': '2025-06-02T02:08:09.799514', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:09.799514', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11259628827335439021, 'uuid_mslong': 41078149242766739}}, 'parent_type': 'node-profile', 'parent_uuid': 'e5731a99-e81d-4044-8c64-b1da863ad0ae', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '0091f05b-eda5-4593-9c42-3cc32c13b2ad'}, 'oper': 'CREATE', 'request-id': 'req-c829fd55-c61d-4ba1-a882-97f54749d24c', 'type': 'role_config', 'uuid': '0091f05b-eda5-4593-9c42-3cc32c13b2ad'} 06/02/2025 02:08:09.825 7fad868c0e10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:08:09.902 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx10k', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-qfx10k:basic 06/02/2025 02:08:09.907 7fad8544be10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx10k:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.907 7fad8544be10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx10k:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:09.929 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx10k', 'basic'], 'id_perms': {'created': '2025-06-02T02:08:09.919183', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:09.919183', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9842026208462902031, 'uuid_mslong': 5995401577123498181}}, 'parent_type': 'node-profile', 'parent_uuid': 'e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '5333f1f8-2a43-48c5-8895-e6b0f984130f'}, 'oper': 'CREATE', 'request-id': 'req-53327a9c-48c0-41ca-8a58-c5a5b78f8f8a', 'type': 'role_config', 'uuid': '5333f1f8-2a43-48c5-8895-e6b0f984130f'} 06/02/2025 02:08:10.025 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-mx', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-mx:basic 06/02/2025 02:08:10.030 7fad8582d438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-mx:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-mx", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:10.030 7fad8582d438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-mx:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-mx", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:10.054 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-mx', 'basic'], 'id_perms': {'created': '2025-06-02T02:08:10.043146', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:10.043146', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10341055983739310055, 'uuid_mslong': 205948061892428059}}, 'parent_type': 'node-profile', 'parent_uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '02dbacab-cf47-411b-8f82-cfa0c1358fe7'}, 'oper': 'CREATE', 'request-id': 'req-4f81e1fe-2de8-4a51-b8e9-bf8ab08b5ba1', 'type': 'role_config', 'uuid': '02dbacab-cf47-411b-8f82-cfa0c1358fe7'} 06/02/2025 02:08:10.153 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-srx', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-srx:basic 06/02/2025 02:08:10.159 7fad85337ac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-srx:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-srx", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:10.159 7fad85337ac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-srx:basic url = https://10.0.0.129:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-srx", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:10.185 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-srx', 'basic'], 'id_perms': {'created': '2025-06-02T02:08:10.170634', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:10.170634', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12604801579960005739, 'uuid_mslong': 66470455691659283}}, 'parent_type': 'node-profile', 'parent_uuid': 'a31a5743-de1c-4da8-ba2a-85832e66d98f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '00ec2686-fb8f-4813-aeed-4040fdcc746b'}, 'oper': 'CREATE', 'request-id': 'req-da21be38-77e3-496b-919a-427942147c0b', 'type': 'role_config', 'uuid': '00ec2686-fb8f-4813-aeed-4040fdcc746b'} 06/02/2025 02:08:10.333 7fad85839cc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:10.333 7fad85839cc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:10.352 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f3b356df-de31-47d8-adb7-742df4563d01', 'type': 'role_definition', 'uuid': 'e937569b-4baf-44ef-bee1-576678d926f7'} 06/02/2025 02:08:10.502 7fad85167e10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:10.502 7fad85167e10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:10.512 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-70604d01-d4a3-462d-9fbb-387f42fbaab1', 'type': 'role_definition', 'uuid': 'e937569b-4baf-44ef-bee1-576678d926f7'} 06/02/2025 02:08:10.663 7fad850832e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:10.663 7fad850832e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:10.670 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c653c21c-babf-42a4-874d-519d0b6d9c33', 'type': 'role_definition', 'uuid': 'e937569b-4baf-44ef-bee1-576678d926f7'} 06/02/2025 02:08:10.817 7fad854c1e10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "cb0389f9-1567-420c-9e91-0d5e6b6fc4df", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:10.817 7fad854c1e10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "cb0389f9-1567-420c-9e91-0d5e6b6fc4df", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:10.835 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-96f2db2d-8989-4845-9e31-d3061c3ed784', 'type': 'role_definition', 'uuid': 'e937569b-4baf-44ef-bee1-576678d926f7'} 06/02/2025 02:08:10.988 7fad85834240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:10.989 7fad85834240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:11.007 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b2ba6463-ddc0-430c-9c5b-e3b717cb9d06', 'type': 'role_definition', 'uuid': 'e937569b-4baf-44ef-bee1-576678d926f7'} 06/02/2025 02:08:11.152 7fad85099780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:11.152 7fad85099780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:11.160 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b1e0ec6a-de9e-4eb1-b4a0-b98970b1434e', 'type': 'role_definition', 'uuid': 'e937569b-4baf-44ef-bee1-576678d926f7'} 06/02/2025 02:08:11.267 7fad85601438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:11.267 7fad85601438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:11.267 7fad85601438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:11.267 7fad85601438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:11.268 7fad85601438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:11.268 7fad85601438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:11.268 7fad85601438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:11.268 7fad85601438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:11.268 7fad85601438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:11.268 7fad85601438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:11.269 7fad85601438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:11.269 7fad85601438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:08:11.269 7fad85601438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:11.315 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "4fc374f8-4f71-4f73-b777-c76103d0d97f", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:11.331 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f455e99e-96c2-453c-a05b-ef626ba3de84', 'type': 'role_definition', 'uuid': 'e937569b-4baf-44ef-bee1-576678d926f7'} 06/02/2025 02:08:11.476 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:11.485 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c553fbad-ea97-4794-9abd-bd758b182c5a', 'type': 'role_definition', 'uuid': 'e937569b-4baf-44ef-bee1-576678d926f7'} 06/02/2025 02:08:11.634 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:11.643 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e4e20f48-ffcb-49b3-a44b-8e71a633612d', 'type': 'role_definition', 'uuid': 'e937569b-4baf-44ef-bee1-576678d926f7'} 06/02/2025 02:08:11.716 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:11.799 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "overlay-role", "ref-uuid": "287bad2a-fdd1-45a7-aa65-ddc815d80c5c", "ref-fq-name": ["default-global-system-config", "erb-ucast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:11.808 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-87d3b6f3-c977-4ecc-b766-22a0e5b7cfcf', 'type': 'role_definition', 'uuid': 'e937569b-4baf-44ef-bee1-576678d926f7'} 06/02/2025 02:08:11.956 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 748bad6c-d887-4679-baab-48a5d4aebb04 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "748bad6c-d887-4679-baab-48a5d4aebb04", "ref-type": "feature", "ref-uuid": "4fc374f8-4f71-4f73-b777-c76103d0d97f", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:11.969 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-fb2e96fa-49c6-4b01-a297-23f718bdad38', 'type': 'role_definition', 'uuid': '748bad6c-d887-4679-baab-48a5d4aebb04'} 06/02/2025 02:08:12.113 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 748bad6c-d887-4679-baab-48a5d4aebb04 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "748bad6c-d887-4679-baab-48a5d4aebb04", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:12.122 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-88a5f7bc-1496-42df-ab39-1f25621bb2ac', 'type': 'role_definition', 'uuid': '748bad6c-d887-4679-baab-48a5d4aebb04'} 06/02/2025 02:08:12.267 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 748bad6c-d887-4679-baab-48a5d4aebb04 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "748bad6c-d887-4679-baab-48a5d4aebb04", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:12.275 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-9ce7a1bc-c5cd-446c-adf2-c229d761751d', 'type': 'role_definition', 'uuid': '748bad6c-d887-4679-baab-48a5d4aebb04'} 06/02/2025 02:08:12.424 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 748bad6c-d887-4679-baab-48a5d4aebb04 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "748bad6c-d887-4679-baab-48a5d4aebb04", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:12.431 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f4a6abce-bff5-4f4c-b02e-9daed6760980', 'type': 'role_definition', 'uuid': '748bad6c-d887-4679-baab-48a5d4aebb04'} 06/02/2025 02:08:12.580 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 748bad6c-d887-4679-baab-48a5d4aebb04 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "748bad6c-d887-4679-baab-48a5d4aebb04", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:12.590 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-9812faad-f7c8-4c20-b171-05b77690a93f', 'type': 'role_definition', 'uuid': '748bad6c-d887-4679-baab-48a5d4aebb04'} 06/02/2025 02:08:12.718 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:12.735 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 748bad6c-d887-4679-baab-48a5d4aebb04 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "748bad6c-d887-4679-baab-48a5d4aebb04", "ref-type": "feature", "ref-uuid": "cb0389f9-1567-420c-9e91-0d5e6b6fc4df", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:12.745 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-42127fcf-cde5-4115-944c-b48fac7be6d2', 'type': 'role_definition', 'uuid': '748bad6c-d887-4679-baab-48a5d4aebb04'} 06/02/2025 02:08:12.897 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 748bad6c-d887-4679-baab-48a5d4aebb04 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "748bad6c-d887-4679-baab-48a5d4aebb04", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:12.907 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8bf6f4a2-7818-433a-a044-aebd3a6b0ebc', 'type': 'role_definition', 'uuid': '748bad6c-d887-4679-baab-48a5d4aebb04'} 06/02/2025 02:08:13.051 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 748bad6c-d887-4679-baab-48a5d4aebb04 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "748bad6c-d887-4679-baab-48a5d4aebb04", "ref-type": "overlay-role", "ref-uuid": "62ebf4ec-07f8-4006-b598-96fb8c20e7ba", "ref-fq-name": ["default-global-system-config", "crb-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:13.060 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c4354841-76c9-4e17-abaa-d37d3e29fc81', 'type': 'role_definition', 'uuid': '748bad6c-d887-4679-baab-48a5d4aebb04'} 06/02/2025 02:08:13.211 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22561407-b132-477e-8b56-93b592c7e4ba object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "22561407-b132-477e-8b56-93b592c7e4ba", "ref-type": "feature", "ref-uuid": "4fc374f8-4f71-4f73-b777-c76103d0d97f", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:13.222 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-ba7720e3-d45b-46dd-958d-398a6d415a6c', 'type': 'role_definition', 'uuid': '22561407-b132-477e-8b56-93b592c7e4ba'} 06/02/2025 02:08:13.368 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22561407-b132-477e-8b56-93b592c7e4ba object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "22561407-b132-477e-8b56-93b592c7e4ba", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:13.378 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-a74034ba-5649-48ea-bdab-f46bb616634b', 'type': 'role_definition', 'uuid': '22561407-b132-477e-8b56-93b592c7e4ba'} 06/02/2025 02:08:13.525 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22561407-b132-477e-8b56-93b592c7e4ba object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "22561407-b132-477e-8b56-93b592c7e4ba", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:13.539 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-19eae4de-608f-4159-a5ba-8325f910d81f', 'type': 'role_definition', 'uuid': '22561407-b132-477e-8b56-93b592c7e4ba'} 06/02/2025 02:08:13.683 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22561407-b132-477e-8b56-93b592c7e4ba object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "22561407-b132-477e-8b56-93b592c7e4ba", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:13.692 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-865bec12-1b8d-438f-9433-8b09b4f94273', 'type': 'role_definition', 'uuid': '22561407-b132-477e-8b56-93b592c7e4ba'} 06/02/2025 02:08:13.719 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:13.840 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22561407-b132-477e-8b56-93b592c7e4ba object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "22561407-b132-477e-8b56-93b592c7e4ba", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:13.848 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-ad278418-dc42-4adc-83d1-1213eb0d8069', 'type': 'role_definition', 'uuid': '22561407-b132-477e-8b56-93b592c7e4ba'} 06/02/2025 02:08:13.998 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22561407-b132-477e-8b56-93b592c7e4ba object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "22561407-b132-477e-8b56-93b592c7e4ba", "ref-type": "feature", "ref-uuid": "cb0389f9-1567-420c-9e91-0d5e6b6fc4df", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:14.008 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-263d48f7-3236-49cf-b778-de36e48182f7', 'type': 'role_definition', 'uuid': '22561407-b132-477e-8b56-93b592c7e4ba'} 06/02/2025 02:08:14.166 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22561407-b132-477e-8b56-93b592c7e4ba object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "22561407-b132-477e-8b56-93b592c7e4ba", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:14.174 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-a3006aba-f35e-4867-8410-2447d7de5653', 'type': 'role_definition', 'uuid': '22561407-b132-477e-8b56-93b592c7e4ba'} 06/02/2025 02:08:14.321 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22561407-b132-477e-8b56-93b592c7e4ba object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "22561407-b132-477e-8b56-93b592c7e4ba", "ref-type": "overlay-role", "ref-uuid": "62ebf4ec-07f8-4006-b598-96fb8c20e7ba", "ref-fq-name": ["default-global-system-config", "crb-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:14.329 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-34db49b2-5684-4a03-b5a1-ea99ec14c751', 'type': 'role_definition', 'uuid': '22561407-b132-477e-8b56-93b592c7e4ba'} 06/02/2025 02:08:14.480 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:14.492 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-828c6217-a240-423f-b6d9-5ca05072ed54', 'type': 'role_definition', 'uuid': '7c08e916-6a3c-4dd9-a557-4134d0b0eee8'} 06/02/2025 02:08:14.640 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:14.651 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-65bfe48c-655e-45f1-a68b-3a53a5430a73', 'type': 'role_definition', 'uuid': '7c08e916-6a3c-4dd9-a557-4134d0b0eee8'} 06/02/2025 02:08:14.720 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:14.804 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:14.814 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e0ab78bc-479d-4954-ac60-63367929e688', 'type': 'role_definition', 'uuid': '7c08e916-6a3c-4dd9-a557-4134d0b0eee8'} 06/02/2025 02:08:14.965 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "feature", "ref-uuid": "4fc374f8-4f71-4f73-b777-c76103d0d97f", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:14.976 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-9c86d783-c84e-4e0f-b208-7bc8d4a9b817', 'type': 'role_definition', 'uuid': '7c08e916-6a3c-4dd9-a557-4134d0b0eee8'} 06/02/2025 02:08:15.125 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:15.134 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-77fcfed4-b35c-42c6-ba65-f63304d409ad', 'type': 'role_definition', 'uuid': '7c08e916-6a3c-4dd9-a557-4134d0b0eee8'} 06/02/2025 02:08:15.267 7fad8561e978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:15.277 7fad850a5198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:15.277 7fad850a5198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:15.284 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-f2a8ce00-0e04-4abd-a225-48f1e0d378fe', 'type': 'role_definition', 'uuid': '7c08e916-6a3c-4dd9-a557-4134d0b0eee8'} 06/02/2025 02:08:15.436 7fad85604780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "overlay-role", "ref-uuid": "df00e683-9489-4ec3-b716-fd93966ddf34", "ref-fq-name": ["default-global-system-config", "crb-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:15.437 7fad85604780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "overlay-role", "ref-uuid": "df00e683-9489-4ec3-b716-fd93966ddf34", "ref-fq-name": ["default-global-system-config", "crb-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:15.450 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-23935175-6c0d-495d-b502-9dc14a95212b', 'type': 'role_definition', 'uuid': '7c08e916-6a3c-4dd9-a557-4134d0b0eee8'} 06/02/2025 02:08:15.596 7fad8502dcc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:15.597 7fad8502dcc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:15.608 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-c79b7e0e-277d-4253-9e1b-5c1d00ed3ede', 'type': 'role_definition', 'uuid': '7c08e916-6a3c-4dd9-a557-4134d0b0eee8'} 06/02/2025 02:08:15.721 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:15.757 7fad8503bd68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:15.810 7fad8503bd68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:15.821 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b0a3a3bf-e8c2-40ad-8dd4-d46ec1918741', 'type': 'role_definition', 'uuid': '74d8464c-ad19-49ca-a22f-4a12c83c7f9a'} 06/02/2025 02:08:15.968 7fad850a0978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:15.968 7fad850a0978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:15.996 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6ea16f70-0bd9-46d7-9ac5-c76ff86220ad', 'type': 'role_definition', 'uuid': '74d8464c-ad19-49ca-a22f-4a12c83c7f9a'} 06/02/2025 02:08:16.150 7fad85141a20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:16.150 7fad85141a20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:16.161 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5c747323-a631-4cd9-b2e1-0a0a2e15512f', 'type': 'role_definition', 'uuid': '74d8464c-ad19-49ca-a22f-4a12c83c7f9a'} 06/02/2025 02:08:16.325 7fad850a00f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:16.326 7fad850a00f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:16.337 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-df258498-fc5c-49f8-ad9d-752a29a2351f', 'type': 'role_definition', 'uuid': '74d8464c-ad19-49ca-a22f-4a12c83c7f9a'} 06/02/2025 02:08:16.480 7fad86204240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "4fc374f8-4f71-4f73-b777-c76103d0d97f", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:16.480 7fad86204240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "4fc374f8-4f71-4f73-b777-c76103d0d97f", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:16.489 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b3e77a7e-6d58-4de8-838e-ee32c0bd3d85', 'type': 'role_definition', 'uuid': '74d8464c-ad19-49ca-a22f-4a12c83c7f9a'} 06/02/2025 02:08:16.640 7fad85fa6978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:16.641 7fad85fa6978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:16.650 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1dbc3290-04f6-41c1-91d3-6c8d159f5919', 'type': 'role_definition', 'uuid': '74d8464c-ad19-49ca-a22f-4a12c83c7f9a'} 06/02/2025 02:08:16.722 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:16.801 7fad85620198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "overlay-role", "ref-uuid": "df00e683-9489-4ec3-b716-fd93966ddf34", "ref-fq-name": ["default-global-system-config", "crb-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:16.801 7fad85620198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "overlay-role", "ref-uuid": "df00e683-9489-4ec3-b716-fd93966ddf34", "ref-fq-name": ["default-global-system-config", "crb-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:16.811 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-42cbe7f4-52ed-468d-8fe5-510c6d12cd9e', 'type': 'role_definition', 'uuid': '74d8464c-ad19-49ca-a22f-4a12c83c7f9a'} 06/02/2025 02:08:16.965 7fad854d1e10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:16.965 7fad854d1e10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:16.974 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ad80b8cf-5ecd-402e-afda-abf68bcc9cd4', 'type': 'role_definition', 'uuid': '74d8464c-ad19-49ca-a22f-4a12c83c7f9a'} 06/02/2025 02:08:17.121 7fad850a0240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:17.122 7fad850a0240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:17.131 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8da86b8c-0974-4d8e-bae9-8379a945cd09', 'type': 'role_definition', 'uuid': 'ec6a8691-ced8-47cd-a0f6-1559747b8c8f'} 06/02/2025 02:08:17.277 7fad855e6d68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:17.277 7fad855e6d68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:17.285 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-7de32522-6e1c-4f51-a812-5fd58581fcbf', 'type': 'role_definition', 'uuid': 'ec6a8691-ced8-47cd-a0f6-1559747b8c8f'} 06/02/2025 02:08:17.429 7fad85074d68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:17.429 7fad85074d68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:17.436 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-3fc12922-c302-4199-86fe-addc83815906', 'type': 'role_definition', 'uuid': 'ec6a8691-ced8-47cd-a0f6-1559747b8c8f'} 06/02/2025 02:08:17.580 7fad85603588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:17.580 7fad85603588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:17.589 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-c14adfe1-ff1f-4124-a4f3-04e557a89345', 'type': 'role_definition', 'uuid': 'ec6a8691-ced8-47cd-a0f6-1559747b8c8f'} 06/02/2025 02:08:17.724 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:17.737 7fad855642e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:17.737 7fad855642e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:17.746 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-aaa1ec10-d9e0-4a89-a23d-a270a6dba4c1', 'type': 'role_definition', 'uuid': 'ec6a8691-ced8-47cd-a0f6-1559747b8c8f'} 06/02/2025 02:08:17.898 7fad850a0a20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "overlay-role", "ref-uuid": "30e5c906-8b22-46bd-b941-c2f2047f5ebd", "ref-fq-name": ["default-global-system-config", "crb-mcast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:17.898 7fad850a0a20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "overlay-role", "ref-uuid": "30e5c906-8b22-46bd-b941-c2f2047f5ebd", "ref-fq-name": ["default-global-system-config", "crb-mcast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:17.912 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-77606562-426a-408a-99c6-26e37436058a', 'type': 'role_definition', 'uuid': 'ec6a8691-ced8-47cd-a0f6-1559747b8c8f'} 06/02/2025 02:08:18.067 7fad85074eb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:18.067 7fad85074eb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:18.077 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-fb85230f-2363-4fbc-b4c4-b72a4c74b04e', 'type': 'role_definition', 'uuid': 'ec6a8691-ced8-47cd-a0f6-1559747b8c8f'} 06/02/2025 02:08:18.236 7fad8545ad68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:18.237 7fad8545ad68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:18.249 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8ecc1d09-1bdc-4f05-9c9d-ecf31be4e3f2', 'type': 'role_definition', 'uuid': '6abf66e8-7d25-46fd-9fe6-41baad03fb57'} 06/02/2025 02:08:18.404 7fad85620780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:18.404 7fad85620780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:18.415 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-444a483c-ba22-4eb2-8dc2-16c904680f37', 'type': 'role_definition', 'uuid': '6abf66e8-7d25-46fd-9fe6-41baad03fb57'} 06/02/2025 02:08:18.567 7fad8520f828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:18.568 7fad8520f828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:18.576 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-293bef68-eb59-48b4-a203-2021716bbd6c', 'type': 'role_definition', 'uuid': '6abf66e8-7d25-46fd-9fe6-41baad03fb57'} 06/02/2025 02:08:18.727 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:18.732 7fad85836f60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:18.732 7fad85836f60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:18.740 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4e9f74e5-d151-4f46-b2b5-35c1942f26d9', 'type': 'role_definition', 'uuid': '6abf66e8-7d25-46fd-9fe6-41baad03fb57'} 06/02/2025 02:08:18.897 7fad8520fe10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:18.897 7fad8520fe10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:18.904 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-bf7818c7-7fee-4eca-bc63-b50f2e26c5a2', 'type': 'role_definition', 'uuid': '6abf66e8-7d25-46fd-9fe6-41baad03fb57'} 06/02/2025 02:08:19.053 7fad8532eb70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "overlay-role", "ref-uuid": "30e5c906-8b22-46bd-b941-c2f2047f5ebd", "ref-fq-name": ["default-global-system-config", "crb-mcast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:19.053 7fad8532eb70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "overlay-role", "ref-uuid": "30e5c906-8b22-46bd-b941-c2f2047f5ebd", "ref-fq-name": ["default-global-system-config", "crb-mcast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:19.077 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-daf274ba-b55e-4749-8f16-47aada3463ac', 'type': 'role_definition', 'uuid': '6abf66e8-7d25-46fd-9fe6-41baad03fb57'} 06/02/2025 02:08:19.214 7fad85836198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:19.214 7fad85836198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:19.225 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-dbe813e8-ccb9-4572-9551-c4063acacd90', 'type': 'role_definition', 'uuid': '6abf66e8-7d25-46fd-9fe6-41baad03fb57'} 06/02/2025 02:08:19.376 7fad8520f588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:19.376 7fad8520f588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:19.390 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-bb0e86e1-62b9-45bb-a581-8589667ac4af', 'type': 'role_definition', 'uuid': '360d0da8-948e-4d58-ad55-21aa642c7ad3'} 06/02/2025 02:08:19.542 7fad85566b70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:19.542 7fad85566b70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:19.551 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-61f43065-11d0-4918-b903-1cedc934fd77', 'type': 'role_definition', 'uuid': '360d0da8-948e-4d58-ad55-21aa642c7ad3'} 06/02/2025 02:08:19.701 7fad85451198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:19.702 7fad85451198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:19.708 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-2e9f259d-79ba-40b7-b5ea-949cd2d6f104', 'type': 'role_definition', 'uuid': '360d0da8-948e-4d58-ad55-21aa642c7ad3'} 06/02/2025 02:08:19.728 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:19.861 7fad854cb828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:19.861 7fad854cb828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:19.873 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-defb6383-20c1-4862-b8e7-77379eae6c86', 'type': 'role_definition', 'uuid': '360d0da8-948e-4d58-ad55-21aa642c7ad3'} 06/02/2025 02:08:20.037 7fad8502d240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "feature", "ref-uuid": "7c786468-1907-4a31-9fec-4d7221ab179e", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:20.037 7fad8502d240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "feature", "ref-uuid": "7c786468-1907-4a31-9fec-4d7221ab179e", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:20.048 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-cf2750fd-e975-45ff-9ba3-08d1557e946f', 'type': 'role_definition', 'uuid': '360d0da8-948e-4d58-ad55-21aa642c7ad3'} 06/02/2025 02:08:20.203 7fad8515f4e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:20.203 7fad8515f4e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:20.214 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e51640af-bcf3-46fc-8b1c-de7f38a1de9f', 'type': 'role_definition', 'uuid': '360d0da8-948e-4d58-ad55-21aa642c7ad3'} 06/02/2025 02:08:20.270 7fad8561e978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:20.271 7fad8561e978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:20.271 7fad8561e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:20.271 7fad8561e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:20.271 7fad8561e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:20.271 7fad8561e978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:20.272 7fad8561e978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:20.272 7fad8561e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:20.272 7fad8561e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:20.272 7fad8561e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:20.272 7fad8561e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:20.272 7fad8561e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:08:20.273 7fad8561e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:20.360 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:20.369 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-b73e9710-c330-4674-934b-da94407037b2', 'type': 'role_definition', 'uuid': '360d0da8-948e-4d58-ad55-21aa642c7ad3'} 06/02/2025 02:08:20.517 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "overlay-role", "ref-uuid": "1bd302da-e0b7-41ee-94d1-0d18f3ec4207", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:20.540 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-c196880d-3b4f-4ef8-800d-aa6f68f86f7a', 'type': 'role_definition', 'uuid': '360d0da8-948e-4d58-ad55-21aa642c7ad3'} 06/02/2025 02:08:20.685 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:20.693 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-1b4366cf-1b72-4322-a538-c6f2abc18668', 'type': 'role_definition', 'uuid': '360d0da8-948e-4d58-ad55-21aa642c7ad3'} 06/02/2025 02:08:20.730 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:20.849 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 404adfbd-f4b5-4376-8c86-8314a7f7a8b4 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "404adfbd-f4b5-4376-8c86-8314a7f7a8b4", "ref-type": "physical-role", "ref-uuid": "c5559de7-cd53-4fa7-995c-54804d905f7c", "ref-fq-name": ["default-global-system-config", "superspine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:20.858 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-2cb2f2ef-c0c6-44df-844f-b82bd98f08d7', 'type': 'role_definition', 'uuid': '404adfbd-f4b5-4376-8c86-8314a7f7a8b4'} 06/02/2025 02:08:21.020 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 404adfbd-f4b5-4376-8c86-8314a7f7a8b4 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "404adfbd-f4b5-4376-8c86-8314a7f7a8b4", "ref-type": "overlay-role", "ref-uuid": "b253a4be-4889-42c0-af56-9f4e50dd5691", "ref-fq-name": ["default-global-system-config", "lean"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:21.041 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-56797e2a-6806-4291-823c-8a61fd4d4e46', 'type': 'role_definition', 'uuid': '404adfbd-f4b5-4376-8c86-8314a7f7a8b4'} 06/02/2025 02:08:21.186 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 404adfbd-f4b5-4376-8c86-8314a7f7a8b4 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "404adfbd-f4b5-4376-8c86-8314a7f7a8b4", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:21.224 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-9e516071-50a0-4dd7-bb9c-a64d059a1fe0', 'type': 'role_definition', 'uuid': '404adfbd-f4b5-4376-8c86-8314a7f7a8b4'} 06/02/2025 02:08:21.371 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 404adfbd-f4b5-4376-8c86-8314a7f7a8b4 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "404adfbd-f4b5-4376-8c86-8314a7f7a8b4", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:21.380 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-74cdbf5e-d05b-4ee3-93f7-59098aa804ed', 'type': 'role_definition', 'uuid': '404adfbd-f4b5-4376-8c86-8314a7f7a8b4'} 06/02/2025 02:08:21.538 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 404adfbd-f4b5-4376-8c86-8314a7f7a8b4 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "404adfbd-f4b5-4376-8c86-8314a7f7a8b4", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:21.551 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-d6b361c2-b7c3-49b7-91de-70e6b542ed8f', 'type': 'role_definition', 'uuid': '404adfbd-f4b5-4376-8c86-8314a7f7a8b4'} 06/02/2025 02:08:21.707 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51bb9405-8338-4114-86f2-71c0c9cf1f01 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "51bb9405-8338-4114-86f2-71c0c9cf1f01", "ref-type": "overlay-role", "ref-uuid": "b253a4be-4889-42c0-af56-9f4e50dd5691", "ref-fq-name": ["default-global-system-config", "lean"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:21.720 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-17b2feb7-9434-40ed-8cd7-a8015f766c8a', 'type': 'role_definition', 'uuid': '51bb9405-8338-4114-86f2-71c0c9cf1f01'} 06/02/2025 02:08:21.731 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:21.868 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51bb9405-8338-4114-86f2-71c0c9cf1f01 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "51bb9405-8338-4114-86f2-71c0c9cf1f01", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:21.883 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-1e485c7b-067d-48de-88aa-520330e84bbb', 'type': 'role_definition', 'uuid': '51bb9405-8338-4114-86f2-71c0c9cf1f01'} 06/02/2025 02:08:22.031 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51bb9405-8338-4114-86f2-71c0c9cf1f01 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "51bb9405-8338-4114-86f2-71c0c9cf1f01", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:22.039 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-a8880f96-8380-47d8-8d81-1cc64c9b75de', 'type': 'role_definition', 'uuid': '51bb9405-8338-4114-86f2-71c0c9cf1f01'} 06/02/2025 02:08:22.192 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 94d3d7b8-655b-40b0-9c46-58846a3ad652 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "94d3d7b8-655b-40b0-9c46-58846a3ad652", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:22.204 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-441ed0d0-b975-4ada-ab77-107efe9a740d', 'type': 'role_definition', 'uuid': '94d3d7b8-655b-40b0-9c46-58846a3ad652'} 06/02/2025 02:08:22.348 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 94d3d7b8-655b-40b0-9c46-58846a3ad652 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "94d3d7b8-655b-40b0-9c46-58846a3ad652", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:22.356 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2454c7d8-45c3-4f00-9a94-b6b50f9ea098', 'type': 'role_definition', 'uuid': '94d3d7b8-655b-40b0-9c46-58846a3ad652'} 06/02/2025 02:08:22.501 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 94d3d7b8-655b-40b0-9c46-58846a3ad652 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "94d3d7b8-655b-40b0-9c46-58846a3ad652", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:22.513 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-cddf9f04-dca9-4bbd-b15f-93812b2c1d77', 'type': 'role_definition', 'uuid': '94d3d7b8-655b-40b0-9c46-58846a3ad652'} 06/02/2025 02:08:22.656 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 94d3d7b8-655b-40b0-9c46-58846a3ad652 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "94d3d7b8-655b-40b0-9c46-58846a3ad652", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:22.663 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7179b9ee-bead-4447-b9c9-b79b8d74d022', 'type': 'role_definition', 'uuid': '94d3d7b8-655b-40b0-9c46-58846a3ad652'} 06/02/2025 02:08:22.733 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:22.824 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 94d3d7b8-655b-40b0-9c46-58846a3ad652 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "94d3d7b8-655b-40b0-9c46-58846a3ad652", "ref-type": "feature", "ref-uuid": "7c786468-1907-4a31-9fec-4d7221ab179e", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:22.835 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d45a4485-4b3d-4e83-bf63-38d6b79b830a', 'type': 'role_definition', 'uuid': '94d3d7b8-655b-40b0-9c46-58846a3ad652'} 06/02/2025 02:08:22.991 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 94d3d7b8-655b-40b0-9c46-58846a3ad652 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "94d3d7b8-655b-40b0-9c46-58846a3ad652", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:23.015 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7eeb19ed-77ed-4d10-864f-6312bd808097', 'type': 'role_definition', 'uuid': '94d3d7b8-655b-40b0-9c46-58846a3ad652'} 06/02/2025 02:08:23.158 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 94d3d7b8-655b-40b0-9c46-58846a3ad652 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "94d3d7b8-655b-40b0-9c46-58846a3ad652", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:23.170 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-73f7d680-994d-43e8-aac1-dc1360b05515', 'type': 'role_definition', 'uuid': '94d3d7b8-655b-40b0-9c46-58846a3ad652'} 06/02/2025 02:08:23.530 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 94d3d7b8-655b-40b0-9c46-58846a3ad652 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "94d3d7b8-655b-40b0-9c46-58846a3ad652", "ref-type": "overlay-role", "ref-uuid": "1bd302da-e0b7-41ee-94d1-0d18f3ec4207", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:23.543 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b57b8a5b-6f1d-4de8-81bb-ca9ccfad9840', 'type': 'role_definition', 'uuid': '94d3d7b8-655b-40b0-9c46-58846a3ad652'} 06/02/2025 02:08:23.695 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 94d3d7b8-655b-40b0-9c46-58846a3ad652 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "94d3d7b8-655b-40b0-9c46-58846a3ad652", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:23.708 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-49498177-ee10-481a-8e34-53c3e313d673', 'type': 'role_definition', 'uuid': '94d3d7b8-655b-40b0-9c46-58846a3ad652'} 06/02/2025 02:08:23.734 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:23.848 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:23.859 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-2a46ba31-fd05-45e4-aac9-8458f12d54cc', 'type': 'role_definition', 'uuid': '7253891c-2b86-4092-9f96-f2c485f94fc3'} 06/02/2025 02:08:24.005 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:24.015 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e24ddd7c-3845-4583-8aba-82ef9129a0e4', 'type': 'role_definition', 'uuid': '7253891c-2b86-4092-9f96-f2c485f94fc3'} 06/02/2025 02:08:24.173 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:24.180 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-b3da945d-cf18-4be0-9087-b36002cef69e', 'type': 'role_definition', 'uuid': '7253891c-2b86-4092-9f96-f2c485f94fc3'} 06/02/2025 02:08:24.273 7fad8583bac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:24.331 7fad8543ab70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:24.332 7fad8543ab70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:24.342 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-f941fff8-4d5e-436e-a315-7e65220cb180', 'type': 'role_definition', 'uuid': '7253891c-2b86-4092-9f96-f2c485f94fc3'} 06/02/2025 02:08:24.509 7fad855ca048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "feature", "ref-uuid": "7c786468-1907-4a31-9fec-4d7221ab179e", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:24.509 7fad855ca048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "feature", "ref-uuid": "7c786468-1907-4a31-9fec-4d7221ab179e", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:24.519 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-58ba7f22-9a78-4900-859b-f36094b80443', 'type': 'role_definition', 'uuid': '7253891c-2b86-4092-9f96-f2c485f94fc3'} 06/02/2025 02:08:24.671 7fad85543048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:24.671 7fad85543048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:24.680 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-623324c4-ba38-479f-afc2-0f73344264b7', 'type': 'role_definition', 'uuid': '7253891c-2b86-4092-9f96-f2c485f94fc3'} 06/02/2025 02:08:24.735 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:24.829 7fad8533b828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:24.829 7fad8533b828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:24.837 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-3bc55eaf-4026-4416-8d80-f940fd923e93', 'type': 'role_definition', 'uuid': '7253891c-2b86-4092-9f96-f2c485f94fc3'} 06/02/2025 02:08:24.961 7fad86c2d4e0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:08:24.991 7fad854d5828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "overlay-role", "ref-uuid": "d9ccd16a-6f82-44c7-ade0-8a6ccb809cec", "ref-fq-name": ["default-global-system-config", "dci-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:24.991 7fad854d5828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "overlay-role", "ref-uuid": "d9ccd16a-6f82-44c7-ade0-8a6ccb809cec", "ref-fq-name": ["default-global-system-config", "dci-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:25.001 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-2d1a908d-22f1-4f10-a578-c0e6e93ed85b', 'type': 'role_definition', 'uuid': '7253891c-2b86-4092-9f96-f2c485f94fc3'} 06/02/2025 02:08:25.012 7fad86c2d4e0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:08:25.144 7fad854cb048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:25.144 7fad854cb048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:25.152 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-fd3cfbee-b4c8-47b8-803f-5058ccd96121', 'type': 'role_definition', 'uuid': '7253891c-2b86-4092-9f96-f2c485f94fc3'} 06/02/2025 02:08:25.313 7fad84fc0978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:25.314 7fad84fc0978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:25.326 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d063c052-e32e-4fb0-9ffd-6d3bab471727', 'type': 'role_definition', 'uuid': 'b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5'} 06/02/2025 02:08:25.473 7fad8502d780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:25.474 7fad8502d780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:25.482 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6b136067-8c75-44c1-ac41-9ebad84ce82a', 'type': 'role_definition', 'uuid': 'b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5'} 06/02/2025 02:08:25.637 7fad84fc0198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:25.638 7fad84fc0198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:25.647 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e4f635eb-2821-4d26-b64e-923e98cef354', 'type': 'role_definition', 'uuid': 'b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5'} 06/02/2025 02:08:25.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:25.800 7fad84fc6780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:25.800 7fad84fc6780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:25.808 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f20ea5d4-8a9e-4610-beb9-6593087ba88b', 'type': 'role_definition', 'uuid': 'b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5'} 06/02/2025 02:08:25.961 7fad85057e10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "7c786468-1907-4a31-9fec-4d7221ab179e", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:25.962 7fad85057e10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "7c786468-1907-4a31-9fec-4d7221ab179e", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:25.969 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a4859c99-b09b-477e-8649-00828eec96a6', 'type': 'role_definition', 'uuid': 'b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5'} 06/02/2025 02:08:26.119 7fad8571b2e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:26.119 7fad8571b2e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:26.130 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-475f7a19-f34c-449a-bf8c-e188082e6cf7', 'type': 'role_definition', 'uuid': 'b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5'} 06/02/2025 02:08:26.272 7fad8503ba20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:26.272 7fad8503ba20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:26.281 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1c5d6e2f-65c1-4f97-bd59-415821e16295', 'type': 'role_definition', 'uuid': 'b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5'} 06/02/2025 02:08:26.448 7fad84fc6828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "overlay-role", "ref-uuid": "d9ccd16a-6f82-44c7-ade0-8a6ccb809cec", "ref-fq-name": ["default-global-system-config", "dci-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:26.448 7fad84fc6828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "overlay-role", "ref-uuid": "d9ccd16a-6f82-44c7-ade0-8a6ccb809cec", "ref-fq-name": ["default-global-system-config", "dci-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:26.458 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-df5aa6a0-ae6c-4173-bd19-39ed84125a3b', 'type': 'role_definition', 'uuid': 'b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5'} 06/02/2025 02:08:26.609 7fad854b4978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:26.609 7fad854b4978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:26.619 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2d021eea-8dc2-436d-81e3-040210e0689b', 'type': 'role_definition', 'uuid': 'b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5'} 06/02/2025 02:08:26.738 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:26.769 7fad85057390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22561407-b132-477e-8b56-93b592c7e4ba object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "22561407-b132-477e-8b56-93b592c7e4ba", "ref-type": "overlay-role", "ref-uuid": "62ebf4ec-07f8-4006-b598-96fb8c20e7ba", "ref-fq-name": ["default-global-system-config", "crb-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:26.769 7fad85057390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22561407-b132-477e-8b56-93b592c7e4ba object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "22561407-b132-477e-8b56-93b592c7e4ba", "ref-type": "overlay-role", "ref-uuid": "62ebf4ec-07f8-4006-b598-96fb8c20e7ba", "ref-fq-name": ["default-global-system-config", "crb-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:26.778 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-03cd821c-2d33-4ba4-98ef-c96f8f1de0bc', 'type': 'role_definition', 'uuid': '22561407-b132-477e-8b56-93b592c7e4ba'} 06/02/2025 02:08:26.922 7fad8532cac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2409783c-4535-40e6-8ec6-898c98c7661f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2409783c-4535-40e6-8ec6-898c98c7661f", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:26.922 7fad8532cac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2409783c-4535-40e6-8ec6-898c98c7661f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2409783c-4535-40e6-8ec6-898c98c7661f", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:26.933 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-afd6561e-e58e-435e-b2b9-c858f27b1aee', 'type': 'role_definition', 'uuid': '2409783c-4535-40e6-8ec6-898c98c7661f'} 06/02/2025 02:08:27.086 7fad84fc0588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2409783c-4535-40e6-8ec6-898c98c7661f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2409783c-4535-40e6-8ec6-898c98c7661f", "ref-type": "feature", "ref-uuid": "9d7bfdf0-d333-425a-8835-c8b64e2c98ed", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:27.087 7fad84fc0588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2409783c-4535-40e6-8ec6-898c98c7661f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2409783c-4535-40e6-8ec6-898c98c7661f", "ref-type": "feature", "ref-uuid": "9d7bfdf0-d333-425a-8835-c8b64e2c98ed", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:27.097 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2c5098ae-b5d2-4953-ada8-2b76da7a97f2', 'type': 'role_definition', 'uuid': '2409783c-4535-40e6-8ec6-898c98c7661f'} 06/02/2025 02:08:27.254 7fad8517c2e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2409783c-4535-40e6-8ec6-898c98c7661f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2409783c-4535-40e6-8ec6-898c98c7661f", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:27.254 7fad8517c2e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2409783c-4535-40e6-8ec6-898c98c7661f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2409783c-4535-40e6-8ec6-898c98c7661f", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:27.262 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-717c60fe-5beb-47d0-b52e-af7784f24756', 'type': 'role_definition', 'uuid': '2409783c-4535-40e6-8ec6-898c98c7661f'} 06/02/2025 02:08:27.412 7fad8533e390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ebe7b062-f229-4b46-8470-ea07168d7be1 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ebe7b062-f229-4b46-8470-ea07168d7be1", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:27.412 7fad8533e390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ebe7b062-f229-4b46-8470-ea07168d7be1 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ebe7b062-f229-4b46-8470-ea07168d7be1", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:27.422 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-325d5d47-ff54-4811-ba4f-35aa4857e584', 'type': 'role_definition', 'uuid': 'ebe7b062-f229-4b46-8470-ea07168d7be1'} 06/02/2025 02:08:27.565 7fad85178048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ebe7b062-f229-4b46-8470-ea07168d7be1 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ebe7b062-f229-4b46-8470-ea07168d7be1", "ref-type": "feature", "ref-uuid": "9d7bfdf0-d333-425a-8835-c8b64e2c98ed", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:27.565 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ebe7b062-f229-4b46-8470-ea07168d7be1 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ebe7b062-f229-4b46-8470-ea07168d7be1", "ref-type": "feature", "ref-uuid": "9d7bfdf0-d333-425a-8835-c8b64e2c98ed", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:27.574 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-302c824e-2882-4091-8d58-0a5e234bf12b', 'type': 'role_definition', 'uuid': 'ebe7b062-f229-4b46-8470-ea07168d7be1'} 06/02/2025 02:08:27.725 7fad855640f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ebe7b062-f229-4b46-8470-ea07168d7be1 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ebe7b062-f229-4b46-8470-ea07168d7be1", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:27.725 7fad855640f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ebe7b062-f229-4b46-8470-ea07168d7be1 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ebe7b062-f229-4b46-8470-ea07168d7be1", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:27.739 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:27.741 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-2fb703e0-c95b-47b2-839f-0f06980bd14a', 'type': 'role_definition', 'uuid': 'ebe7b062-f229-4b46-8470-ea07168d7be1'} 06/02/2025 02:08:27.896 7fad85826828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 824f6478-ad66-49c7-a1aa-271ca0100379 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "824f6478-ad66-49c7-a1aa-271ca0100379", "ref-type": "feature", "ref-uuid": "9d7bfdf0-d333-425a-8835-c8b64e2c98ed", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:27.896 7fad85826828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 824f6478-ad66-49c7-a1aa-271ca0100379 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "824f6478-ad66-49c7-a1aa-271ca0100379", "ref-type": "feature", "ref-uuid": "9d7bfdf0-d333-425a-8835-c8b64e2c98ed", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:27.906 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c76f2019-fa8b-4b9e-ae08-b4d766bbac9e', 'type': 'role_definition', 'uuid': '824f6478-ad66-49c7-a1aa-271ca0100379'} 06/02/2025 02:08:28.053 7fad85564ac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 824f6478-ad66-49c7-a1aa-271ca0100379 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "824f6478-ad66-49c7-a1aa-271ca0100379", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.053 7fad85564ac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 824f6478-ad66-49c7-a1aa-271ca0100379 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "824f6478-ad66-49c7-a1aa-271ca0100379", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.060 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f679c7e1-9bc1-4105-8807-85db2a945778', 'type': 'role_definition', 'uuid': '824f6478-ad66-49c7-a1aa-271ca0100379'} 06/02/2025 02:08:28.213 7fad8533e390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29f273d7-ccb9-4f6e-bb2b-eb82717b2955 object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "29f273d7-ccb9-4f6e-bb2b-eb82717b2955", "ref-type": "feature", "ref-uuid": "9d7bfdf0-d333-425a-8835-c8b64e2c98ed", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.213 7fad8533e390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29f273d7-ccb9-4f6e-bb2b-eb82717b2955 object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "29f273d7-ccb9-4f6e-bb2b-eb82717b2955", "ref-type": "feature", "ref-uuid": "9d7bfdf0-d333-425a-8835-c8b64e2c98ed", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.229 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-f3ac9f39-bdd0-4e2c-8021-572e8cbec20b', 'type': 'role_definition', 'uuid': '29f273d7-ccb9-4f6e-bb2b-eb82717b2955'} 06/02/2025 02:08:28.377 7fad85c64588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29f273d7-ccb9-4f6e-bb2b-eb82717b2955 object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "29f273d7-ccb9-4f6e-bb2b-eb82717b2955", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.377 7fad85c64588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29f273d7-ccb9-4f6e-bb2b-eb82717b2955 object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "29f273d7-ccb9-4f6e-bb2b-eb82717b2955", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.388 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-b58aad11-8995-4805-ae6c-7842dda1786a', 'type': 'role_definition', 'uuid': '29f273d7-ccb9-4f6e-bb2b-eb82717b2955'} 06/02/2025 02:08:28.535 7fad85448828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2409783c-4535-40e6-8ec6-898c98c7661f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2409783c-4535-40e6-8ec6-898c98c7661f", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.535 7fad85448828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2409783c-4535-40e6-8ec6-898c98c7661f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2409783c-4535-40e6-8ec6-898c98c7661f", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.546 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e6bc9e65-8084-4888-8c22-5c1da8ac01a4', 'type': 'role_definition', 'uuid': '2409783c-4535-40e6-8ec6-898c98c7661f'} 06/02/2025 02:08:28.569 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 06/02/2025 02:08:28.570 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 06/02/2025 02:08:28.570 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 06/02/2025 02:08:28.570 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 06/02/2025 02:08:28.570 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 06/02/2025 02:08:28.570 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 06/02/2025 02:08:28.570 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 06/02/2025 02:08:28.570 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 06/02/2025 02:08:28.570 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 06/02/2025 02:08:28.570 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 06/02/2025 02:08:28.570 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 06/02/2025 02:08:28.571 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 06/02/2025 02:08:28.571 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 06/02/2025 02:08:28.571 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 06/02/2025 02:08:28.571 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 06/02/2025 02:08:28.571 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 06/02/2025 02:08:28.571 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 06/02/2025 02:08:28.571 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 06/02/2025 02:08:28.571 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 06/02/2025 02:08:28.571 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 06/02/2025 02:08:28.571 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 06/02/2025 02:08:28.571 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 06/02/2025 02:08:28.571 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 06/02/2025 02:08:28.571 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 06/02/2025 02:08:28.572 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 06/02/2025 02:08:28.572 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 06/02/2025 02:08:28.572 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 06/02/2025 02:08:28.572 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 06/02/2025 02:08:28.572 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 06/02/2025 02:08:28.572 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 06/02/2025 02:08:28.572 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 06/02/2025 02:08:28.572 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 06/02/2025 02:08:28.572 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 06/02/2025 02:08:28.572 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 06/02/2025 02:08:28.675 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_routers in resource routing-instance: 'bgp_routers' 06/02/2025 02:08:28.675 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_refs in resource routing-instance: 'routing_instance_refs' 06/02/2025 02:08:28.675 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_target_refs in resource routing-instance: 'route_target_refs' 06/02/2025 02:08:28.675 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource routing-instance: 'tag_refs' 06/02/2025 02:08:28.675 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource routing-instance: 'virtual_machine_interface_back_refs' 06/02/2025 02:08:28.676 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_aggregate_back_refs in resource routing-instance: 'route_aggregate_back_refs' 06/02/2025 02:08:28.676 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_back_refs in resource routing-instance: 'routing_policy_back_refs' 06/02/2025 02:08:28.676 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_back_refs in resource routing-instance: 'routing_instance_back_refs' 06/02/2025 02:08:28.695 7fad851f0588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2409783c-4535-40e6-8ec6-898c98c7661f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2409783c-4535-40e6-8ec6-898c98c7661f", "ref-type": "overlay-role", "ref-uuid": "1ad8db01-cdf4-4984-b25f-390f584041db", "ref-fq-name": ["default-global-system-config", "ar-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.695 7fad851f0588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2409783c-4535-40e6-8ec6-898c98c7661f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2409783c-4535-40e6-8ec6-898c98c7661f", "ref-type": "overlay-role", "ref-uuid": "1ad8db01-cdf4-4984-b25f-390f584041db", "ref-fq-name": ["default-global-system-config", "ar-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.703 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-cb0fde78-e3de-4283-8442-3014a1da7b97', 'type': 'role_definition', 'uuid': '2409783c-4535-40e6-8ec6-898c98c7661f'} 06/02/2025 02:08:28.728 7fad85034048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3b45d35b-de57-4285-b542-427e524b5c84 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.129:8082/global-system-config/3b45d35b-de57-4285-b542-427e524b5c84 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.129 body = {"global-system-config": {"uuid": "3b45d35b-de57-4285-b542-427e524b5c84", "ip_fabric_subnets": {"subnet": [{"ip_prefix": "10.0.0.0", "ip_prefix_len": 24}]}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.728 7fad85034048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3b45d35b-de57-4285-b542-427e524b5c84 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.129:8082/global-system-config/3b45d35b-de57-4285-b542-427e524b5c84 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.129 body = {"global-system-config": {"uuid": "3b45d35b-de57-4285-b542-427e524b5c84", "ip_fabric_subnets": {"subnet": [{"ip_prefix": "10.0.0.0", "ip_prefix_len": 24}]}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:28.745 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-201f94f2-2c66-4bd3-a018-632853dbd1c8', 'type': 'global_system_config', 'uuid': '3b45d35b-de57-4285-b542-427e524b5c84'} 06/02/2025 02:08:28.843 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'] not found in DB: Unknown id: virtual_router default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 06/02/2025 02:08:28.850 7fad84fc0e10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ebe7b062-f229-4b46-8470-ea07168d7be1 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ebe7b062-f229-4b46-8470-ea07168d7be1", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.851 7fad84fc0e10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ebe7b062-f229-4b46-8470-ea07168d7be1 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ebe7b062-f229-4b46-8470-ea07168d7be1", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.852 7fad85fa6828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_router identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/virtual-routers operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.129 body = {"virtual-router": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "global-system-config", "virtual_router_dpdk_enabled": false, "virtual_router_ip_address": "10.0.0.129", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.852 7fad85fa6828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_router identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/virtual-routers operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.129 body = {"virtual-router": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"], "parent_type": "global-system-config", "virtual_router_dpdk_enabled": false, "virtual_router_ip_address": "10.0.0.129", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-542-1"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:28.858 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-80f75184-5d15-4a3f-b6e7-2b6e1f6170bf', 'type': 'role_definition', 'uuid': 'ebe7b062-f229-4b46-8470-ea07168d7be1'} 06/02/2025 02:08:28.876 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'obj_dict': {'display_name': 'cn-jenkins-deploy-platform-juju-os-542-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'id_perms': {'created': '2025-06-02T02:08:28.867250', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:28.867250', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10668624042139358189, 'uuid_mslong': 5584225116653570807}}, 'parent_type': 'global-system-config', 'parent_uuid': '3b45d35b-de57-4285-b542-427e524b5c84', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4d7f2728-37f3-4af7-940e-910aa1e893ed', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.0.0.129'}, 'oper': 'CREATE', 'request-id': 'req-d7a3c118-d74b-47b1-8651-51dfd03f5824', 'type': 'virtual_router', 'uuid': '4d7f2728-37f3-4af7-940e-910aa1e893ed'} 06/02/2025 02:08:28.876 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectVRouter:ContrailConfigTrace] map 06/02/2025 02:08:28.969 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:08:28.969 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:08:28.969 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:08:28.969 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:08:28.969 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:08:28.970 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:08:28.970 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:08:28.970 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:08:29.016 7fad854af198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ebe7b062-f229-4b46-8470-ea07168d7be1 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ebe7b062-f229-4b46-8470-ea07168d7be1", "ref-type": "overlay-role", "ref-uuid": "1ad8db01-cdf4-4984-b25f-390f584041db", "ref-fq-name": ["default-global-system-config", "ar-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:29.016 7fad854af198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ebe7b062-f229-4b46-8470-ea07168d7be1 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ebe7b062-f229-4b46-8470-ea07168d7be1", "ref-type": "overlay-role", "ref-uuid": "1ad8db01-cdf4-4984-b25f-390f584041db", "ref-fq-name": ["default-global-system-config", "ar-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:29.024 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-73465a47-ef1c-46ce-8ddd-bb34fd0a31b6', 'type': 'role_definition', 'uuid': 'ebe7b062-f229-4b46-8470-ea07168d7be1'} 06/02/2025 02:08:29.125 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field access_control_lists in resource virtual-network: 'access_control_lists' 06/02/2025 02:08:29.125 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field floating_ip_pools in resource virtual-network: 'floating_ip_pools' 06/02/2025 02:08:29.125 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alias_ip_pools in resource virtual-network: 'alias_ip_pools' 06/02/2025 02:08:29.125 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instances in resource virtual-network: 'routing_instances' 06/02/2025 02:08:29.125 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bridge_domains in resource virtual-network: 'bridge_domains' 06/02/2025 02:08:29.125 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_object_refs in resource virtual-network: 'security_logging_object_refs' 06/02/2025 02:08:29.125 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_refs in resource virtual-network: 'qos_config_refs' 06/02/2025 02:08:29.125 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-network: 'network_ipam_refs' 06/02/2025 02:08:29.125 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_policy_refs in resource virtual-network: 'network_policy_refs' 06/02/2025 02:08:29.125 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_network_refs in resource virtual-network: 'virtual_network_refs' 06/02/2025 02:08:29.125 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_health_check_refs in resource virtual-network: 'service_health_check_refs' 06/02/2025 02:08:29.125 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_table_refs in resource virtual-network: 'route_table_refs' 06/02/2025 02:08:29.126 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field multicast_policy_refs in resource virtual-network: 'multicast_policy_refs' 06/02/2025 02:08:29.126 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgpvpn_refs in resource virtual-network: 'bgpvpn_refs' 06/02/2025 02:08:29.126 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_map_refs in resource virtual-network: 'intent_map_refs' 06/02/2025 02:08:29.126 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_refs in resource virtual-network: 'routing_policy_refs' 06/02/2025 02:08:29.126 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-network: 'tag_refs' 06/02/2025 02:08:29.126 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_network_back_refs in resource virtual-network: 'virtual_network_back_refs' 06/02/2025 02:08:29.126 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource virtual-network: 'virtual_machine_interface_back_refs' 06/02/2025 02:08:29.126 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-network: 'instance_ip_back_refs' 06/02/2025 02:08:29.126 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-network: 'physical_router_back_refs' 06/02/2025 02:08:29.126 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field port_tuple_back_refs in resource virtual-network: 'port_tuple_back_refs' 06/02/2025 02:08:29.126 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field logical_router_back_refs in resource virtual-network: 'logical_router_back_refs' 06/02/2025 02:08:29.127 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_node_back_refs in resource virtual-network: 'flow_node_back_refs' 06/02/2025 02:08:29.127 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field firewall_rule_back_refs in resource virtual-network: 'firewall_rule_back_refs' 06/02/2025 02:08:29.127 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnect_back_refs in resource virtual-network: 'data_center_interconnect_back_refs' 06/02/2025 02:08:29.127 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabric_back_refs in resource virtual-network: 'fabric_back_refs' 06/02/2025 02:08:29.127 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field host_based_service_back_refs in resource virtual-network: 'host_based_service_back_refs' 06/02/2025 02:08:29.177 7fad84fc0588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 824f6478-ad66-49c7-a1aa-271ca0100379 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "824f6478-ad66-49c7-a1aa-271ca0100379", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:29.177 7fad84fc0588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 824f6478-ad66-49c7-a1aa-271ca0100379 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "824f6478-ad66-49c7-a1aa-271ca0100379", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:29.178 7fad86c2da20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1', 'vhost0'] not found in DB: Unknown id: virtual_machine_interface default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1:vhost0 06/02/2025 02:08:29.182 7fad84fc0588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_machine_interface identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1:vhost0 url = https://10.0.0.129:8082/virtual-machine-interfaces operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.129 body = {"virtual-machine-interface": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1", "vhost0"], "parent_type": "virtual-router", "virtual_machine_interface_disable_policy": true, "virtual_network_refs": [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "e321a686-481b-40eb-913d-c368c1a2c12e"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vhost0"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:29.183 7fad84fc0588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_machine_interface identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1:vhost0 url = https://10.0.0.129:8082/virtual-machine-interfaces operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.129 body = {"virtual-machine-interface": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1", "vhost0"], "parent_type": "virtual-router", "virtual_machine_interface_disable_policy": true, "virtual_network_refs": [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "e321a686-481b-40eb-913d-c368c1a2c12e"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vhost0"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:29.188 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c8374c9a-3b04-43fa-b108-8dc7e9612988', 'type': 'role_definition', 'uuid': '824f6478-ad66-49c7-a1aa-271ca0100379'} 06/02/2025 02:08:29.212 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1', 'vhost0'], 'id_perms': {'created': '2025-06-02T02:08:29.200507', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:29.200507', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9665749023934223835, 'uuid_mslong': 3492446560602770684}}, 'parent_type': 'virtual-router', 'parent_uuid': '4d7f2728-37f3-4af7-940e-910aa1e893ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3077a9a4-a1c3-4cfc-8623-a386a3ad95db', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:30:77:a9:a4:a1']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'e321a686-481b-40eb-913d-c368c1a2c12e'}]}, 'oper': 'CREATE', 'request-id': 'req-07855bd1-a16a-4913-b63e-e2905997cfe4', 'type': 'virtual_machine_interface', 'uuid': '3077a9a4-a1c3-4cfc-8623-a386a3ad95db'} 06/02/2025 02:08:29.212 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectVMITable:ContrailConfigTrace] map 06/02/2025 02:08:29.217 7fad868cbb70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3077a9a4-a1c3-4cfc-8623-a386a3ad95db object_type = virtual_machine_interface identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1:vhost0 url = http://127.0.0.1/ref-update operation = ref-update domain = default-domain >> 06/02/2025 02:08:29.217 7fad868cbb70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3077a9a4-a1c3-4cfc-8623-a386a3ad95db object_type = virtual_machine_interface identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1:vhost0 url = http://127.0.0.1/ref-update operation = ref-update domain = default-domain >> 06/02/2025 02:08:29.225 7fad85057c18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9f2327dc-c527-41a5-8345-983201b80262 object_type = access_control_list identifier_name = default-domain:default-project:ip-fabric:ip-fabric url = https://10.0.0.129:8082/access-control-list/9f2327dc-c527-41a5-8345-983201b80262 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"access-control-list": {"uuid": "9f2327dc-c527-41a5-8345-983201b80262", "access_control_list_entries": {"dynamic": false, "acl_rule": [{"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "deny", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000002", "direction": "<>"}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}]}, "access_control_list_hash": 8261104760608219195}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:29.226 7fad85057c18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9f2327dc-c527-41a5-8345-983201b80262 object_type = access_control_list identifier_name = default-domain:default-project:ip-fabric:ip-fabric url = https://10.0.0.129:8082/access-control-list/9f2327dc-c527-41a5-8345-983201b80262 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"access-control-list": {"uuid": "9f2327dc-c527-41a5-8345-983201b80262", "access_control_list_entries": {"dynamic": false, "acl_rule": [{"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "deny", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000002", "direction": "<>"}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}]}, "access_control_list_hash": 8261104760608219195}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:29.238 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-07855bd1-a16a-4913-b63e-e2905997cfe4', 'type': 'virtual_machine_interface', 'uuid': '3077a9a4-a1c3-4cfc-8623-a386a3ad95db'} 06/02/2025 02:08:29.257 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-cd3c3275-aac0-41de-9b2d-735e263205a7', 'type': 'access_control_list', 'uuid': '9f2327dc-c527-41a5-8345-983201b80262'} 06/02/2025 02:08:29.275 7fad8583bac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:29.275 7fad8583bac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:29.275 7fad8583bac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:29.275 7fad8583bac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:29.275 7fad8583bac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:29.275 7fad8583bac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:29.276 7fad8583bac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 elements = { display_name : "cn-jenkins-deploy-platform-juju-os-542-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 5584225116653570807, "uuid_lslong": 10668624042139358189}, "enable": true, "created": "2025-06-02T02:08:28.867250", "last_modified": "2025-06-02T02:08:28.867250", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3b45d35b-de57-4285-b542-427e524b5c84"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "4d7f2728-37f3-4af7-940e-910aa1e893ed"virtual_router_dpdk_enabled : falsevirtual_router_ip_address : "10.0.0.129" } deleted = False >> 06/02/2025 02:08:29.276 7fad8583bac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:29.276 7fad8583bac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:29.276 7fad8583bac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1:vhost0 elements = { display_name : "vhost0"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1", "vhost0"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3492446560602770684, "uuid_lslong": 9665749023934223835}, "enable": true, "created": "2025-06-02T02:08:29.200507", "last_modified": "2025-06-02T02:08:29.200507", "description": null, "user_visible": true, "creator": null}parent_type : "virtual-router"parent_uuid : "4d7f2728-37f3-4af7-940e-910aa1e893ed"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "3077a9a4-a1c3-4cfc-8623-a386a3ad95db"virtual_machine_interface_disable_policy : truevirtual_machine_interface_mac_addresses : {"mac_address": ["02:30:77:a9:a4:a1"]}virtual_network_refs : [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "e321a686-481b-40eb-913d-c368c1a2c12e"}] } deleted = False >> 06/02/2025 02:08:29.276 7fad8583bac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:29.276 7fad8583bac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:29.276 7fad8583bac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1:vhost0 elements = { display_name : "vhost0"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1", "vhost0"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3492446560602770684, "uuid_lslong": 9665749023934223835}, "enable": true, "created": "2025-06-02T02:08:29.200507", "last_modified": "2025-06-02T02:08:29.223018", "description": null, "user_visible": true, "creator": null}parent_type : "virtual-router"parent_uuid : "4d7f2728-37f3-4af7-940e-910aa1e893ed"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}routing_instance_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "ip-fabric"], "attr": {"direction": "both", "vlan_tag": null, "src_mac": null, "dst_mac": null, "mpls_label": null, "service_chain_address": null, "ipv6_service_chain_address": null, "protocol": null}, "uuid": "4439bfb8-6651-482b-a1c3-f5e57eb0f0f9"}]uuid : "3077a9a4-a1c3-4cfc-8623-a386a3ad95db"virtual_machine_interface_disable_policy : truevirtual_machine_interface_mac_addresses : {"mac_address": ["02:30:77:a9:a4:a1"]}virtual_network_refs : [{"to": ["default-domain", "default-project", "ip-fabric"], "attr": null, "uuid": "e321a686-481b-40eb-913d-c368c1a2c12e"}] } deleted = False >> 06/02/2025 02:08:29.276 7fad8583bac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:29.276 7fad8583bac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:29.277 7fad8583bac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:29.277 7fad8583bac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:29.277 7fad8583bac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:29.277 7fad8583bac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:29.277 7fad8583bac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:29.278 7fad8583bac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:08:29.278 7fad8583bac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:29.336 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 824f6478-ad66-49c7-a1aa-271ca0100379 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "824f6478-ad66-49c7-a1aa-271ca0100379", "ref-type": "overlay-role", "ref-uuid": "363b5a08-46ef-47bb-82dd-2687757611de", "ref-fq-name": ["default-global-system-config", "ar-client"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:29.355 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4ac19a7b-4ef1-4435-9d1b-ca64a3716f69', 'type': 'role_definition', 'uuid': '824f6478-ad66-49c7-a1aa-271ca0100379'} 06/02/2025 02:08:29.498 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29f273d7-ccb9-4f6e-bb2b-eb82717b2955 object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "29f273d7-ccb9-4f6e-bb2b-eb82717b2955", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:29.508 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-cedeccce-97be-4861-8980-e843f91fe81c', 'type': 'role_definition', 'uuid': '29f273d7-ccb9-4f6e-bb2b-eb82717b2955'} 06/02/2025 02:08:29.668 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e73a7db7-6981-446b-b364-f49a7014c75d object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e73a7db7-6981-446b-b364-f49a7014c75d", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:29.686 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-7828df6b-d6c5-4d03-9ab0-872c532d64bd', 'type': 'role_definition', 'uuid': 'e73a7db7-6981-446b-b364-f49a7014c75d'} 06/02/2025 02:08:29.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:29.836 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c1b0189-a360-48ff-a820-1153157e0aa7 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c1b0189-a360-48ff-a820-1153157e0aa7", "ref-type": "physical-role", "ref-uuid": "c5559de7-cd53-4fa7-995c-54804d905f7c", "ref-fq-name": ["default-global-system-config", "superspine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:29.846 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-2d939a63-2af5-4239-a105-b86bae60ed52', 'type': 'role_definition', 'uuid': '7c1b0189-a360-48ff-a820-1153157e0aa7'} 06/02/2025 02:08:30.000 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9198a318-7fbb-4785-869e-b267bbb4fc03 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "9198a318-7fbb-4785-869e-b267bbb4fc03", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:30.011 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f3650f21-087b-429a-84d9-6671687b1a2f', 'type': 'role_definition', 'uuid': '9198a318-7fbb-4785-869e-b267bbb4fc03'} 06/02/2025 02:08:30.161 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29f273d7-ccb9-4f6e-bb2b-eb82717b2955 object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "29f273d7-ccb9-4f6e-bb2b-eb82717b2955", "ref-type": "overlay-role", "ref-uuid": "363b5a08-46ef-47bb-82dd-2687757611de", "ref-fq-name": ["default-global-system-config", "ar-client"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:30.171 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-ba887178-31da-4670-a5c1-e0ceeda2e473', 'type': 'role_definition', 'uuid': '29f273d7-ccb9-4f6e-bb2b-eb82717b2955'} 06/02/2025 02:08:30.317 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c1b0189-a360-48ff-a820-1153157e0aa7 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c1b0189-a360-48ff-a820-1153157e0aa7", "ref-type": "overlay-role", "ref-uuid": "2c01469c-9e72-41bf-a8bb-d22355980dea", "ref-fq-name": ["default-global-system-config", "route-reflector"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:30.325 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-3fb3b397-e4a2-4ece-b695-e3fcdc3cc0b2', 'type': 'role_definition', 'uuid': '7c1b0189-a360-48ff-a820-1153157e0aa7'} 06/02/2025 02:08:30.468 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c1b0189-a360-48ff-a820-1153157e0aa7 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c1b0189-a360-48ff-a820-1153157e0aa7", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:30.476 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-9d79889c-b6f2-4508-85ce-fe2e58e2b03a', 'type': 'role_definition', 'uuid': '7c1b0189-a360-48ff-a820-1153157e0aa7'} 06/02/2025 02:08:30.621 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c1b0189-a360-48ff-a820-1153157e0aa7 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c1b0189-a360-48ff-a820-1153157e0aa7", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:30.633 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-f0838b22-8fa1-4ce6-b9e5-6755a244c9e7', 'type': 'role_definition', 'uuid': '7c1b0189-a360-48ff-a820-1153157e0aa7'} 06/02/2025 02:08:30.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:30.787 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c1b0189-a360-48ff-a820-1153157e0aa7 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c1b0189-a360-48ff-a820-1153157e0aa7", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:30.796 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-1a454f05-d927-43f0-b2b3-7f1cea095d9c', 'type': 'role_definition', 'uuid': '7c1b0189-a360-48ff-a820-1153157e0aa7'} 06/02/2025 02:08:30.947 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c1b0189-a360-48ff-a820-1153157e0aa7 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c1b0189-a360-48ff-a820-1153157e0aa7", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:30.957 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-63700f24-8d97-48e7-a997-0e168833f3b7', 'type': 'role_definition', 'uuid': '7c1b0189-a360-48ff-a820-1153157e0aa7'} 06/02/2025 02:08:31.108 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e73a7db7-6981-446b-b364-f49a7014c75d object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e73a7db7-6981-446b-b364-f49a7014c75d", "ref-type": "overlay-role", "ref-uuid": "2c01469c-9e72-41bf-a8bb-d22355980dea", "ref-fq-name": ["default-global-system-config", "route-reflector"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:31.116 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-f712d49b-eb19-4193-9794-52bd6a59ca30', 'type': 'role_definition', 'uuid': 'e73a7db7-6981-446b-b364-f49a7014c75d'} 06/02/2025 02:08:31.264 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e73a7db7-6981-446b-b364-f49a7014c75d object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e73a7db7-6981-446b-b364-f49a7014c75d", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:31.322 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-6cd3d4a9-63c5-4399-a53b-7bd528df3755', 'type': 'role_definition', 'uuid': 'e73a7db7-6981-446b-b364-f49a7014c75d'} 06/02/2025 02:08:31.468 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e73a7db7-6981-446b-b364-f49a7014c75d object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e73a7db7-6981-446b-b364-f49a7014c75d", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:31.490 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-4ab952fe-f756-43f4-9dd4-5eb30cd63bbb', 'type': 'role_definition', 'uuid': 'e73a7db7-6981-446b-b364-f49a7014c75d'} 06/02/2025 02:08:31.623 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e73a7db7-6981-446b-b364-f49a7014c75d object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e73a7db7-6981-446b-b364-f49a7014c75d", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:31.631 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-c15c2464-ff40-4b9e-aab6-cad8afdbdde8', 'type': 'role_definition', 'uuid': 'e73a7db7-6981-446b-b364-f49a7014c75d'} 06/02/2025 02:08:31.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:31.775 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9198a318-7fbb-4785-869e-b267bbb4fc03 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "9198a318-7fbb-4785-869e-b267bbb4fc03", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:31.782 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2df4376c-09e7-415c-a670-2ecf7731d7a0', 'type': 'role_definition', 'uuid': '9198a318-7fbb-4785-869e-b267bbb4fc03'} 06/02/2025 02:08:31.927 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9198a318-7fbb-4785-869e-b267bbb4fc03 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "9198a318-7fbb-4785-869e-b267bbb4fc03", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:31.938 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-90ee16d7-282c-400d-9c9d-87d81a7590c2', 'type': 'role_definition', 'uuid': '9198a318-7fbb-4785-869e-b267bbb4fc03'} 06/02/2025 02:08:32.079 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9198a318-7fbb-4785-869e-b267bbb4fc03 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "9198a318-7fbb-4785-869e-b267bbb4fc03", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:32.090 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-130fc232-5eee-410f-a581-4934860685c0', 'type': 'role_definition', 'uuid': '9198a318-7fbb-4785-869e-b267bbb4fc03'} 06/02/2025 02:08:32.232 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9198a318-7fbb-4785-869e-b267bbb4fc03 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "9198a318-7fbb-4785-869e-b267bbb4fc03", "ref-type": "overlay-role", "ref-uuid": "2c01469c-9e72-41bf-a8bb-d22355980dea", "ref-fq-name": ["default-global-system-config", "route-reflector"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:32.242 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-bb4ceab1-e179-49f4-b881-f8f10d2ff375', 'type': 'role_definition', 'uuid': '9198a318-7fbb-4785-869e-b267bbb4fc03'} 06/02/2025 02:08:32.385 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e937569b-4baf-44ef-bee1-576678d926f7 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e937569b-4baf-44ef-bee1-576678d926f7", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:32.394 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-621bb459-0fc1-444e-aeee-14843d0e70ae', 'type': 'role_definition', 'uuid': 'e937569b-4baf-44ef-bee1-576678d926f7'} 06/02/2025 02:08:32.545 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 748bad6c-d887-4679-baab-48a5d4aebb04 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "748bad6c-d887-4679-baab-48a5d4aebb04", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:32.553 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-85adfdc4-b2f2-45e4-8c1f-9a2385b70b4f', 'type': 'role_definition', 'uuid': '748bad6c-d887-4679-baab-48a5d4aebb04'} 06/02/2025 02:08:32.705 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22561407-b132-477e-8b56-93b592c7e4ba object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "22561407-b132-477e-8b56-93b592c7e4ba", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:32.713 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-1a25fb51-8110-4508-9039-d1fb46250c8c', 'type': 'role_definition', 'uuid': '22561407-b132-477e-8b56-93b592c7e4ba'} 06/02/2025 02:08:32.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:32.864 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:32.875 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d9718496-47fc-4787-a346-f959cbc422c6', 'type': 'role_definition', 'uuid': '7c08e916-6a3c-4dd9-a557-4134d0b0eee8'} 06/02/2025 02:08:33.024 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:33.033 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-96cb8317-d235-499d-a843-b1096c5b19a1', 'type': 'role_definition', 'uuid': 'ec6a8691-ced8-47cd-a0f6-1559747b8c8f'} 06/02/2025 02:08:33.181 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 360d0da8-948e-4d58-ad55-21aa642c7ad3 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "360d0da8-948e-4d58-ad55-21aa642c7ad3", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:33.189 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-660c935e-b6ee-48f0-a53c-380b7ee27e01', 'type': 'role_definition', 'uuid': '360d0da8-948e-4d58-ad55-21aa642c7ad3'} 06/02/2025 02:08:33.275 7fad85178048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:33.332 7fad84f2df60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:33.332 7fad84f2df60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7253891c-2b86-4092-9f96-f2c485f94fc3 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7253891c-2b86-4092-9f96-f2c485f94fc3", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:33.343 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-2393cb11-b9d9-49b1-aee4-e41a810687a7', 'type': 'role_definition', 'uuid': '7253891c-2b86-4092-9f96-f2c485f94fc3'} 06/02/2025 02:08:33.499 7fad853da198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:33.499 7fad853da198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:33.509 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-9fc8b241-51ee-446d-a399-cab2d4c2b2e2', 'type': 'role_definition', 'uuid': '74d8464c-ad19-49ca-a22f-4a12c83c7f9a'} 06/02/2025 02:08:33.663 7fad85074d68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:33.663 7fad85074d68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:33.671 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2771263d-f7ed-42e5-8561-233d461864d5', 'type': 'role_definition', 'uuid': '6abf66e8-7d25-46fd-9fe6-41baad03fb57'} 06/02/2025 02:08:33.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:33.818 7fad84f56780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 94d3d7b8-655b-40b0-9c46-58846a3ad652 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "94d3d7b8-655b-40b0-9c46-58846a3ad652", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:33.819 7fad84f56780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 94d3d7b8-655b-40b0-9c46-58846a3ad652 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "94d3d7b8-655b-40b0-9c46-58846a3ad652", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:33.827 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ab7f8f08-b9ff-49d0-ae9e-07fd5dd7579d', 'type': 'role_definition', 'uuid': '94d3d7b8-655b-40b0-9c46-58846a3ad652'} 06/02/2025 02:08:33.970 7fad8533b588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:33.970 7fad8533b588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:33.977 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-72e3b653-13ae-4571-b06d-32caa9d91323', 'type': 'role_definition', 'uuid': 'b25a13d6-ccda-4b6f-ae2c-a0a5c62782e5'} 06/02/2025 02:08:34.130 7fad8527c828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 824f6478-ad66-49c7-a1aa-271ca0100379 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "824f6478-ad66-49c7-a1aa-271ca0100379", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:34.130 7fad8527c828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 824f6478-ad66-49c7-a1aa-271ca0100379 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "824f6478-ad66-49c7-a1aa-271ca0100379", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:34.138 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-41902f1e-9f3c-4bf0-999a-7a3c66471298', 'type': 'role_definition', 'uuid': '824f6478-ad66-49c7-a1aa-271ca0100379'} 06/02/2025 02:08:34.285 7fad84f562e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29f273d7-ccb9-4f6e-bb2b-eb82717b2955 object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "29f273d7-ccb9-4f6e-bb2b-eb82717b2955", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:34.286 7fad84f562e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29f273d7-ccb9-4f6e-bb2b-eb82717b2955 object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "29f273d7-ccb9-4f6e-bb2b-eb82717b2955", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:34.293 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-346c1ac8-188c-47ae-9bbb-e8a721fea0c9', 'type': 'role_definition', 'uuid': '29f273d7-ccb9-4f6e-bb2b-eb82717b2955'} 06/02/2025 02:08:34.448 7fad85602048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2409783c-4535-40e6-8ec6-898c98c7661f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2409783c-4535-40e6-8ec6-898c98c7661f", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:34.448 7fad85602048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2409783c-4535-40e6-8ec6-898c98c7661f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2409783c-4535-40e6-8ec6-898c98c7661f", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:34.455 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-79d6b0b6-65aa-458d-82a5-f1fd489817ba', 'type': 'role_definition', 'uuid': '2409783c-4535-40e6-8ec6-898c98c7661f'} 06/02/2025 02:08:34.604 7fad85569438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ebe7b062-f229-4b46-8470-ea07168d7be1 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ebe7b062-f229-4b46-8470-ea07168d7be1", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:34.604 7fad85569438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ebe7b062-f229-4b46-8470-ea07168d7be1 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ebe7b062-f229-4b46-8470-ea07168d7be1", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:34.611 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-b7035015-b065-4503-b88d-e9e26b77a06e', 'type': 'role_definition', 'uuid': 'ebe7b062-f229-4b46-8470-ea07168d7be1'} 06/02/2025 02:08:34.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:34.760 7fad85074eb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e73a7db7-6981-446b-b364-f49a7014c75d object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e73a7db7-6981-446b-b364-f49a7014c75d", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:34.761 7fad85074eb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e73a7db7-6981-446b-b364-f49a7014c75d object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "e73a7db7-6981-446b-b364-f49a7014c75d", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:34.768 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-501e39e5-bccd-4903-8590-47ea76ed46c4', 'type': 'role_definition', 'uuid': 'e73a7db7-6981-446b-b364-f49a7014c75d'} 06/02/2025 02:08:34.919 7fad8502d198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9198a318-7fbb-4785-869e-b267bbb4fc03 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "9198a318-7fbb-4785-869e-b267bbb4fc03", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:34.919 7fad8502d198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9198a318-7fbb-4785-869e-b267bbb4fc03 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "9198a318-7fbb-4785-869e-b267bbb4fc03", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:34.928 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b166492a-3573-41b8-ae54-cf5a04f527aa', 'type': 'role_definition', 'uuid': '9198a318-7fbb-4785-869e-b267bbb4fc03'} 06/02/2025 02:08:35.072 7fad854cde10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51bb9405-8338-4114-86f2-71c0c9cf1f01 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "51bb9405-8338-4114-86f2-71c0c9cf1f01", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:35.072 7fad854cde10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51bb9405-8338-4114-86f2-71c0c9cf1f01 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "51bb9405-8338-4114-86f2-71c0c9cf1f01", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:35.080 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-d055f25c-5baa-41ac-9ce3-8ba56be59d4f', 'type': 'role_definition', 'uuid': '51bb9405-8338-4114-86f2-71c0c9cf1f01'} 06/02/2025 02:08:35.233 7fad853522e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:35.233 7fad853522e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:35.241 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-b5a409d4-9de4-4840-b5ef-e1e4530077b8', 'type': 'role_definition', 'uuid': '7c08e916-6a3c-4dd9-a557-4134d0b0eee8'} 06/02/2025 02:08:35.392 7fad85467c18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "feature", "ref-uuid": "cb0389f9-1567-420c-9e91-0d5e6b6fc4df", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:35.393 7fad85467c18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c08e916-6a3c-4dd9-a557-4134d0b0eee8 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c08e916-6a3c-4dd9-a557-4134d0b0eee8", "ref-type": "feature", "ref-uuid": "cb0389f9-1567-420c-9e91-0d5e6b6fc4df", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:35.401 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-b7163290-f937-44c0-bd66-a64414d25cea', 'type': 'role_definition', 'uuid': '7c08e916-6a3c-4dd9-a557-4134d0b0eee8'} 06/02/2025 02:08:35.548 7fad84f3c240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:35.548 7fad84f3c240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:35.557 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2b1a8ff8-ad15-4f19-bb3f-8fa54cc75855', 'type': 'role_definition', 'uuid': '74d8464c-ad19-49ca-a22f-4a12c83c7f9a'} 06/02/2025 02:08:35.705 7fad8502d828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "cb0389f9-1567-420c-9e91-0d5e6b6fc4df", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:35.705 7fad8502d828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 74d8464c-ad19-49ca-a22f-4a12c83c7f9a object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "74d8464c-ad19-49ca-a22f-4a12c83c7f9a", "ref-type": "feature", "ref-uuid": "cb0389f9-1567-420c-9e91-0d5e6b6fc4df", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:35.713 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6352e0f6-e48e-42f8-bdb9-b1e7f6b16cad', 'type': 'role_definition', 'uuid': '74d8464c-ad19-49ca-a22f-4a12c83c7f9a'} 06/02/2025 02:08:35.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:35.862 7fad85141978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:35.862 7fad85141978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:35.871 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-6fa3db8d-dff0-49e7-b401-54bf5a45e8cc', 'type': 'role_definition', 'uuid': 'ec6a8691-ced8-47cd-a0f6-1559747b8c8f'} 06/02/2025 02:08:36.018 7fad8502feb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "cb0389f9-1567-420c-9e91-0d5e6b6fc4df", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:36.018 7fad8502feb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ec6a8691-ced8-47cd-a0f6-1559747b8c8f object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "ec6a8691-ced8-47cd-a0f6-1559747b8c8f", "ref-type": "feature", "ref-uuid": "cb0389f9-1567-420c-9e91-0d5e6b6fc4df", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:36.025 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-dede0e19-d4ed-494a-9290-12ade3c3bfd9', 'type': 'role_definition', 'uuid': 'ec6a8691-ced8-47cd-a0f6-1559747b8c8f'} 06/02/2025 02:08:36.171 7fad853da240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:36.172 7fad853da240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:36.178 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8e018def-a05a-42bb-a645-9dc7a57fdd14', 'type': 'role_definition', 'uuid': '6abf66e8-7d25-46fd-9fe6-41baad03fb57'} 06/02/2025 02:08:36.325 7fad8502dcc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "cb0389f9-1567-420c-9e91-0d5e6b6fc4df", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:36.325 7fad8502dcc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6abf66e8-7d25-46fd-9fe6-41baad03fb57 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "6abf66e8-7d25-46fd-9fe6-41baad03fb57", "ref-type": "feature", "ref-uuid": "cb0389f9-1567-420c-9e91-0d5e6b6fc4df", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:36.333 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6b96a8e3-3cce-4a85-83c1-2c95c76d34e1', 'type': 'role_definition', 'uuid': '6abf66e8-7d25-46fd-9fe6-41baad03fb57'} 06/02/2025 02:08:36.485 7fad85451828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51bb9405-8338-4114-86f2-71c0c9cf1f01 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "51bb9405-8338-4114-86f2-71c0c9cf1f01", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:36.486 7fad85451828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 51bb9405-8338-4114-86f2-71c0c9cf1f01 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "51bb9405-8338-4114-86f2-71c0c9cf1f01", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:36.492 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-ba199d07-52a9-498c-8ffc-8a08ba23b20f', 'type': 'role_definition', 'uuid': '51bb9405-8338-4114-86f2-71c0c9cf1f01'} 06/02/2025 02:08:36.643 7fad853ba390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:36.643 7fad853ba390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "be30b213-6a60-4395-975e-82f3dc713d98", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:36.652 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-0964ff7f-04fb-44a1-a281-e32f7cd1551b', 'type': 'role_definition', 'uuid': '7f8ef064-5ab8-4067-a296-3e6623fbf8bf'} 06/02/2025 02:08:36.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:36.800 7fad85568a20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:36.801 7fad85568a20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "31af7b53-2783-4ddf-8a07-64fa5f1830ba", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:36.807 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-39f05ba4-b7de-47d4-8771-cb1887855ed2', 'type': 'role_definition', 'uuid': '7f8ef064-5ab8-4067-a296-3e6623fbf8bf'} 06/02/2025 02:08:36.956 7fad853abac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:36.957 7fad853abac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "2ac77810-c848-494a-9caa-f008323db1af", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:36.963 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-e4507bde-9bd8-4990-8369-28d6045870b6', 'type': 'role_definition', 'uuid': '7f8ef064-5ab8-4067-a296-3e6623fbf8bf'} 06/02/2025 02:08:37.112 7fad8507eac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:37.112 7fad8507eac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "3cc289fa-cfb6-42cb-a715-faebcacc5bd4", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:37.119 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-c625baa9-5005-4b3b-88b1-9b02a08b49ff', 'type': 'role_definition', 'uuid': '7f8ef064-5ab8-4067-a296-3e6623fbf8bf'} 06/02/2025 02:08:37.276 7fad85836438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:37.276 7fad85836438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "dc2de942-f256-40e3-8779-97cbe530e363", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:37.283 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-10292fee-fb97-4dca-a588-a7138ae8dfa1', 'type': 'role_definition', 'uuid': '7f8ef064-5ab8-4067-a296-3e6623fbf8bf'} 06/02/2025 02:08:37.433 7fad84fc04e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:37.433 7fad84fc04e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "31cf66aa-ff68-49d2-9e63-e505026e8b3d", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:37.443 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-a8420124-f4af-493b-9f78-94c2fae190e5', 'type': 'role_definition', 'uuid': '7f8ef064-5ab8-4067-a296-3e6623fbf8bf'} 06/02/2025 02:08:37.589 7fad8528dac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "cb0389f9-1567-420c-9e91-0d5e6b6fc4df", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:37.589 7fad8528dac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "cb0389f9-1567-420c-9e91-0d5e6b6fc4df", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:37.596 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-a8e9e8ce-12fa-43ee-8f85-99adac15497e', 'type': 'role_definition', 'uuid': '7f8ef064-5ab8-4067-a296-3e6623fbf8bf'} 06/02/2025 02:08:37.740 7fad85352588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:37.741 7fad85352588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "9a7edba7-716b-4ecf-adc3-2b1fd9ecbb2d", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:37.748 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-187e3c42-62de-486f-93cc-0c395376f339', 'type': 'role_definition', 'uuid': '7f8ef064-5ab8-4067-a296-3e6623fbf8bf'} 06/02/2025 02:08:37.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:37.896 7fad8528d978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "4fc374f8-4f71-4f73-b777-c76103d0d97f", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:37.897 7fad8528d978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "feature", "ref-uuid": "4fc374f8-4f71-4f73-b777-c76103d0d97f", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:37.911 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-c005eb35-97a5-4694-89ab-17fcfb736b4f', 'type': 'role_definition', 'uuid': '7f8ef064-5ab8-4067-a296-3e6623fbf8bf'} 06/02/2025 02:08:38.058 7fad85604978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "overlay-role", "ref-uuid": "2371db1b-ef7e-4bf0-acb8-e75252a7654e", "ref-fq-name": ["default-global-system-config", "collapsed-spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:38.058 7fad85604978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "overlay-role", "ref-uuid": "2371db1b-ef7e-4bf0-acb8-e75252a7654e", "ref-fq-name": ["default-global-system-config", "collapsed-spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:38.065 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-4cc77ef5-6e1a-489b-a29a-f7a42f7e8b2a', 'type': 'role_definition', 'uuid': '7f8ef064-5ab8-4067-a296-3e6623fbf8bf'} 06/02/2025 02:08:38.222 7fad84fc06d8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:38.222 7fad84fc06d8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7f8ef064-5ab8-4067-a296-3e6623fbf8bf object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7f8ef064-5ab8-4067-a296-3e6623fbf8bf", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:38.231 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-a06275ce-3611-40b3-9cc5-85df47fb6ada', 'type': 'role_definition', 'uuid': '7f8ef064-5ab8-4067-a296-3e6623fbf8bf'} 06/02/2025 02:08:38.277 7fad85178048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:38.277 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:38.277 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:38.277 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:38.278 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:38.278 7fad85178048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:38.278 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:38.278 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:38.278 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:38.279 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:38.279 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:38.279 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:08:38.279 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:38.378 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2adf1b51-96c0-483d-8a61-a16776d55b30 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2adf1b51-96c0-483d-8a61-a16776d55b30", "ref-type": "feature", "ref-uuid": "bb316e17-91c8-47d7-940a-efd0656ff102", "ref-fq-name": ["default-global-system-config", "pnf-service-chaining"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:38.385 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-34be71a4-6980-4f1c-9a6d-7b236d9fdb12', 'type': 'role_definition', 'uuid': '2adf1b51-96c0-483d-8a61-a16776d55b30'} 06/02/2025 02:08:38.539 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9a1ea5f2-838e-4f92-805c-92e14ba44dcf object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "9a1ea5f2-838e-4f92-805c-92e14ba44dcf", "ref-type": "feature", "ref-uuid": "bb316e17-91c8-47d7-940a-efd0656ff102", "ref-fq-name": ["default-global-system-config", "pnf-service-chaining"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:38.547 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-f9b05682-9a68-4dda-8c50-2f1d2b6d0156', 'type': 'role_definition', 'uuid': '9a1ea5f2-838e-4f92-805c-92e14ba44dcf'} 06/02/2025 02:08:38.691 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c470b7e-2237-4845-aaf1-2055b1b47522 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c470b7e-2237-4845-aaf1-2055b1b47522", "ref-type": "feature", "ref-uuid": "bb316e17-91c8-47d7-940a-efd0656ff102", "ref-fq-name": ["default-global-system-config", "pnf-service-chaining"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:38.700 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6329cd9c-28c5-43bb-8e88-d9b238b2d465', 'type': 'role_definition', 'uuid': '7c470b7e-2237-4845-aaf1-2055b1b47522'} 06/02/2025 02:08:38.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:38.846 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2adf1b51-96c0-483d-8a61-a16776d55b30 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2adf1b51-96c0-483d-8a61-a16776d55b30", "ref-type": "physical-role", "ref-uuid": "688a85af-965a-4b6b-9560-830452278b39", "ref-fq-name": ["default-global-system-config", "pnf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:38.855 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-6255f573-fd7e-453d-9152-7460871f10aa', 'type': 'role_definition', 'uuid': '2adf1b51-96c0-483d-8a61-a16776d55b30'} 06/02/2025 02:08:39.004 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9a1ea5f2-838e-4f92-805c-92e14ba44dcf object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "9a1ea5f2-838e-4f92-805c-92e14ba44dcf", "ref-type": "physical-role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:39.013 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-783340f7-9393-4ba8-a1d5-cf3cf833f25f', 'type': 'role_definition', 'uuid': '9a1ea5f2-838e-4f92-805c-92e14ba44dcf'} 06/02/2025 02:08:39.156 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c470b7e-2237-4845-aaf1-2055b1b47522 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c470b7e-2237-4845-aaf1-2055b1b47522", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:39.165 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-595d4f5c-e269-42c8-8259-69f1859abbf6', 'type': 'role_definition', 'uuid': '7c470b7e-2237-4845-aaf1-2055b1b47522'} 06/02/2025 02:08:39.312 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2adf1b51-96c0-483d-8a61-a16776d55b30 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "2adf1b51-96c0-483d-8a61-a16776d55b30", "ref-type": "overlay-role", "ref-uuid": "edbb94ec-abf7-43ba-ba1c-0d9d43299125", "ref-fq-name": ["default-global-system-config", "pnf-servicechain"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:39.334 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-38cbb37d-f33c-4be1-b860-63adba0a7c8a', 'type': 'role_definition', 'uuid': '2adf1b51-96c0-483d-8a61-a16776d55b30'} 06/02/2025 02:08:39.472 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9a1ea5f2-838e-4f92-805c-92e14ba44dcf object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "9a1ea5f2-838e-4f92-805c-92e14ba44dcf", "ref-type": "overlay-role", "ref-uuid": "edbb94ec-abf7-43ba-ba1c-0d9d43299125", "ref-fq-name": ["default-global-system-config", "pnf-servicechain"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:39.481 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-b22d5a7f-4278-46e8-bfdd-8bad0bd94d79', 'type': 'role_definition', 'uuid': '9a1ea5f2-838e-4f92-805c-92e14ba44dcf'} 06/02/2025 02:08:39.632 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c470b7e-2237-4845-aaf1-2055b1b47522 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "role-definition", "uuid": "7c470b7e-2237-4845-aaf1-2055b1b47522", "ref-type": "overlay-role", "ref-uuid": "edbb94ec-abf7-43ba-ba1c-0d9d43299125", "ref-fq-name": ["default-global-system-config", "pnf-servicechain"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:39.648 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6a561aff-c4b2-4b52-8eb4-a15b1b37251f', 'type': 'role_definition', 'uuid': '7c470b7e-2237-4845-aaf1-2055b1b47522'} 06/02/2025 02:08:39.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:39.785 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "93182d0a-35df-4f17-8fa8-b95115ec5953", "ref-fq-name": ["juniper-qfx5100-48sh-afi"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:39.795 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-52bb2522-e4e7-4537-bae1-67e0342cb6af', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:39.945 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "f4d7cbbd-4522-4f0e-b7ca-2c16fd20d5de", "ref-fq-name": ["juniper-qfx5100-48sh-afo"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:39.953 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-2f65dd75-fc99-4510-8c57-5728a9176a2f', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:40.105 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "92ab4305-359f-4b35-93c5-ec5a47f3eeea", "ref-fq-name": ["juniper-qfx5100-48th-afi"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:40.114 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-000c3d82-39ad-4899-9edd-329a9d3e0df6', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:40.261 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "f3bc4a47-ecf9-4570-b799-4ba8442c792e", "ref-fq-name": ["juniper-qfx5100-48th-afo"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:40.269 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-c4dad585-911b-4a79-83e0-efe14643ba8d', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:40.418 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "79493ecb-21a0-4325-98e5-8a7fe1a458e8", "ref-fq-name": ["juniper-qfx5100-48s-6q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:40.426 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-b5c7db33-adc1-4ead-ad8d-2e8dcd9d33f3', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:40.570 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "359ff836-3f89-4da8-b03d-c60c10a96705", "ref-fq-name": ["juniper-qfx5100-96s-8q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:40.583 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-b44544c7-10e0-426e-93a4-fb1377735534', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:40.733 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "ed2aeca6-c7f4-4fe4-b687-e3231caf062d", "ref-fq-name": ["juniper-qfx5100-48t"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:40.742 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-f534215a-5d8b-4b4b-9f71-092357ba5c04', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:40.894 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "50b1a145-e333-4c43-a0d4-91fb22439d69", "ref-fq-name": ["juniper-qfx5100-48t-6q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:40.902 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-f692ac7f-c9b9-45af-b918-588dc5458a29', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:41.049 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "e3f70095-2144-485d-8550-53bff1dbd3de", "ref-fq-name": ["juniper-qfx5100-24q-2p"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:41.057 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-72849d7d-ff07-4f30-89fc-54f4181b6e96', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:41.205 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "bc516840-0367-418f-8f1b-5574d5fb5bd9", "ref-fq-name": ["juniper-qfx5100-24q-aa"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:41.214 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-558ecdb8-6c3d-4041-9312-e1c6d4dd7a25', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:41.362 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "479788ab-5d18-4bd9-9330-24aa3ab7aa47", "ref-fq-name": ["juniper-qfx5100e-48s-6q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:41.380 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-fda5d5c1-cc30-40eb-b15b-fd7336af4723', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:41.518 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "310bb0a3-bcb1-4f84-9f30-2096e0d5e7d4", "ref-fq-name": ["juniper-qfx5100e-96s-8q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:41.527 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-8013aec4-b277-42e8-8d5c-e2dd13cad929', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:41.677 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "a536809e-6e56-41a4-a885-daa4122a2d6b", "ref-fq-name": ["juniper-qfx5100e-48t-6q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:41.684 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-f52d19b6-c090-4c1c-9762-38790b13b570', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:41.717 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:41.829 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "34cc1637-9519-4a9f-b5a2-9e120b79a7ab", "ref-fq-name": ["juniper-qfx5100e-24q-2p"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:41.836 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-40d98934-86d5-4949-bf74-663e52073d6e', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:41.996 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b996a442-cf9b-4ff5-ad86-5ab6196a9651 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "b996a442-cf9b-4ff5-ad86-5ab6196a9651", "ref-type": "hardware", "ref-uuid": "080ce00f-c9b3-4d89-b4a2-701a1ff9cdb4", "ref-fq-name": ["juniper-qfx5110-48s-4c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:42.013 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-15c9bd29-4adb-47fd-93b1-66d5d932b21b', 'type': 'node_profile', 'uuid': 'b996a442-cf9b-4ff5-ad86-5ab6196a9651'} 06/02/2025 02:08:42.161 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b996a442-cf9b-4ff5-ad86-5ab6196a9651 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "b996a442-cf9b-4ff5-ad86-5ab6196a9651", "ref-type": "hardware", "ref-uuid": "8c72bed6-de53-4709-b0dd-6e0fe59c0733", "ref-fq-name": ["juniper-qfx5110-32q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:42.168 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-3dfa8511-0499-4efc-a34b-d91c9c5711a9', 'type': 'node_profile', 'uuid': 'b996a442-cf9b-4ff5-ad86-5ab6196a9651'} 06/02/2025 02:08:42.278 7fad855688d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:42.322 7fad8606ab70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 82179eeb-03ff-442c-8c9c-fae35cd36588 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "82179eeb-03ff-442c-8c9c-fae35cd36588", "ref-type": "hardware", "ref-uuid": "2ba4a6d1-c490-4568-9568-fb0b35909031", "ref-fq-name": ["juniper-qfx5120-48y-8c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:42.322 7fad8606ab70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 82179eeb-03ff-442c-8c9c-fae35cd36588 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "82179eeb-03ff-442c-8c9c-fae35cd36588", "ref-type": "hardware", "ref-uuid": "2ba4a6d1-c490-4568-9568-fb0b35909031", "ref-fq-name": ["juniper-qfx5120-48y-8c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:42.332 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-1b4fb6d9-0531-49c2-bdb7-13b016955189', 'type': 'node_profile', 'uuid': '82179eeb-03ff-442c-8c9c-fae35cd36588'} 06/02/2025 02:08:42.478 7fad85224390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 82179eeb-03ff-442c-8c9c-fae35cd36588 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "82179eeb-03ff-442c-8c9c-fae35cd36588", "ref-type": "hardware", "ref-uuid": "36503283-76a9-4b4b-808e-336c4b9ec483", "ref-fq-name": ["juniper-qfx5120-32c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:42.478 7fad85224390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 82179eeb-03ff-442c-8c9c-fae35cd36588 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "82179eeb-03ff-442c-8c9c-fae35cd36588", "ref-type": "hardware", "ref-uuid": "36503283-76a9-4b4b-808e-336c4b9ec483", "ref-fq-name": ["juniper-qfx5120-32c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:42.486 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-abaf9ea3-a1e8-40ca-9402-e6f479b0577e', 'type': 'node_profile', 'uuid': '82179eeb-03ff-442c-8c9c-fae35cd36588'} 06/02/2025 02:08:42.642 7fad84f3c780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 82179eeb-03ff-442c-8c9c-fae35cd36588 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "82179eeb-03ff-442c-8c9c-fae35cd36588", "ref-type": "hardware", "ref-uuid": "2cba288f-e942-4395-804d-b0437c594f11", "ref-fq-name": ["juniper-qfx5120-48t-6c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:42.642 7fad84f3c780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 82179eeb-03ff-442c-8c9c-fae35cd36588 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "82179eeb-03ff-442c-8c9c-fae35cd36588", "ref-type": "hardware", "ref-uuid": "2cba288f-e942-4395-804d-b0437c594f11", "ref-fq-name": ["juniper-qfx5120-48t-6c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:42.651 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-4da77e50-10c2-4afa-b943-40cc7edc12c0', 'type': 'node_profile', 'uuid': '82179eeb-03ff-442c-8c9c-fae35cd36588'} 06/02/2025 02:08:42.718 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:42.801 7fad854cd978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "705635cd-aa27-4c5f-9fa3-61133f9a7547", "ref-fq-name": ["juniper-qfx5200-32c-32q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:42.801 7fad854cd978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "705635cd-aa27-4c5f-9fa3-61133f9a7547", "ref-fq-name": ["juniper-qfx5200-32c-32q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:42.808 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-59adcc56-d6f9-4fec-94d7-a9c859cf4a94', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:42.971 7fad850e6438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "2072917c-c88f-4b7c-876f-022ab88e6e2e", "ref-fq-name": ["juniper-qfx5200-48y"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:42.971 7fad850e6438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "2072917c-c88f-4b7c-876f-022ab88e6e2e", "ref-fq-name": ["juniper-qfx5200-48y"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:42.989 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-661056e1-fabe-4736-915b-4eff9a566493', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:43.134 7fad8552d780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "2eb335b4-ba48-4921-9e21-8e28fbb788dc", "ref-fq-name": ["juniper-qfx5210-64c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:43.135 7fad8552d780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "hardware", "ref-uuid": "2eb335b4-ba48-4921-9e21-8e28fbb788dc", "ref-fq-name": ["juniper-qfx5210-64c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:43.144 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-faadaa19-cf01-471a-9ab6-ca1d75368db1', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:43.297 7fad854af6d8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37e33153-3de9-449e-9fee-e4efdcb9d440 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5220 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "37e33153-3de9-449e-9fee-e4efdcb9d440", "ref-type": "hardware", "ref-uuid": "ae56bd49-5050-40ef-a16d-8e4423da0d4b", "ref-fq-name": ["juniper-qfx5220-32cd"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:43.307 7fad854af6d8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37e33153-3de9-449e-9fee-e4efdcb9d440 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5220 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "37e33153-3de9-449e-9fee-e4efdcb9d440", "ref-type": "hardware", "ref-uuid": "ae56bd49-5050-40ef-a16d-8e4423da0d4b", "ref-fq-name": ["juniper-qfx5220-32cd"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:43.318 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-1d488fc4-efc6-47ea-b031-1839182a68aa', 'type': 'node_profile', 'uuid': '37e33153-3de9-449e-9fee-e4efdcb9d440'} 06/02/2025 02:08:43.466 7fad85216630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37e33153-3de9-449e-9fee-e4efdcb9d440 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5220 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "37e33153-3de9-449e-9fee-e4efdcb9d440", "ref-type": "hardware", "ref-uuid": "ac5f3568-1e59-4cc6-8928-8786c3a13cc8", "ref-fq-name": ["juniper-qfx5220-128c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:43.466 7fad85216630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37e33153-3de9-449e-9fee-e4efdcb9d440 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5220 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "37e33153-3de9-449e-9fee-e4efdcb9d440", "ref-type": "hardware", "ref-uuid": "ac5f3568-1e59-4cc6-8928-8786c3a13cc8", "ref-fq-name": ["juniper-qfx5220-128c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:43.473 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-23b8b364-a160-4a82-802a-028433368fdb', 'type': 'node_profile', 'uuid': '37e33153-3de9-449e-9fee-e4efdcb9d440'} 06/02/2025 02:08:43.643 7fad84eab0f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9", "ref-type": "hardware", "ref-uuid": "7bb4e9a2-4f7c-47d8-8470-cf34699722ed", "ref-fq-name": ["juniper-qfx10002-72q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:43.643 7fad84eab0f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9", "ref-type": "hardware", "ref-uuid": "7bb4e9a2-4f7c-47d8-8470-cf34699722ed", "ref-fq-name": ["juniper-qfx10002-72q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:43.654 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-df44cb3f-6b72-4643-a588-4d61d1884276', 'type': 'node_profile', 'uuid': 'e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9'} 06/02/2025 02:08:43.719 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:43.808 7fad8535f8d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9", "ref-type": "hardware", "ref-uuid": "24e287ee-fbf7-4055-bd84-5b52b4ffeddc", "ref-fq-name": ["juniper-qfx10002-36q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:43.808 7fad8535f8d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9", "ref-type": "hardware", "ref-uuid": "24e287ee-fbf7-4055-bd84-5b52b4ffeddc", "ref-fq-name": ["juniper-qfx10002-36q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:43.821 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-2fede9f6-513e-49a4-9199-f827fbefc83a', 'type': 'node_profile', 'uuid': 'e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9'} 06/02/2025 02:08:43.977 7fad85557f60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9", "ref-type": "hardware", "ref-uuid": "f49e503c-3404-4dfa-b213-82271163dbae", "ref-fq-name": ["juniper-qfx10002-60c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:43.977 7fad85557f60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9", "ref-type": "hardware", "ref-uuid": "f49e503c-3404-4dfa-b213-82271163dbae", "ref-fq-name": ["juniper-qfx10002-60c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:43.985 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-e9350de7-b2ad-47b7-9f3d-916227966066', 'type': 'node_profile', 'uuid': 'e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9'} 06/02/2025 02:08:44.143 7fad854cb198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9", "ref-type": "hardware", "ref-uuid": "5e1f99e9-402d-4c5d-ad80-9e84260bec39", "ref-fq-name": ["juniper-qfx10016"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:44.145 7fad854cb198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9", "ref-type": "hardware", "ref-uuid": "5e1f99e9-402d-4c5d-ad80-9e84260bec39", "ref-fq-name": ["juniper-qfx10016"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:44.152 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-6d8080fa-8ab7-406d-8347-d9a507cd9ecf', 'type': 'node_profile', 'uuid': 'e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9'} 06/02/2025 02:08:44.303 7fad853d84e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9", "ref-type": "hardware", "ref-uuid": "8c7185e5-16b3-4af2-924f-53e1d2988d2d", "ref-fq-name": ["juniper-qfx10008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:44.307 7fad853d84e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9", "ref-type": "hardware", "ref-uuid": "8c7185e5-16b3-4af2-924f-53e1d2988d2d", "ref-fq-name": ["juniper-qfx10008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:44.364 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-68b0c745-22dc-4ec1-b068-fd94ecb039f4', 'type': 'node_profile', 'uuid': 'e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9'} 06/02/2025 02:08:44.517 7fad853d8240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9", "ref-type": "hardware", "ref-uuid": "e0c99376-fed8-4e97-81c8-5ede35c0d7ae", "ref-fq-name": ["juniper-vqfx-10000"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:44.517 7fad853d8240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9", "ref-type": "hardware", "ref-uuid": "e0c99376-fed8-4e97-81c8-5ede35c0d7ae", "ref-fq-name": ["juniper-vqfx-10000"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:44.528 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-8cd256fe-d15b-4991-aee6-64b8d47de6fc', 'type': 'node_profile', 'uuid': 'e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9'} 06/02/2025 02:08:44.680 7fad8532e8d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "88ea12a1-b58b-4b2c-aea1-5b1a66282509", "ref-fq-name": ["juniper-mx80"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:44.680 7fad8532e8d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "88ea12a1-b58b-4b2c-aea1-5b1a66282509", "ref-fq-name": ["juniper-mx80"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:44.698 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-3e28837f-370f-4b62-aad4-99dce6883d19', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:44.720 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:44.854 7fad86c2d828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "3afc5de6-49f1-415d-bfec-627bdc2ba95a", "ref-fq-name": ["juniper-mx80-48t"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:44.855 7fad86c2d828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "3afc5de6-49f1-415d-bfec-627bdc2ba95a", "ref-fq-name": ["juniper-mx80-48t"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:44.865 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-1e4a2583-8ec7-4205-ac33-0683c06b9994', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:45.016 7fad8532eac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "1cfe0305-7aa3-4164-8eb3-bbd0c607fb6b", "ref-fq-name": ["juniper-mx204"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:45.016 7fad8532eac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "1cfe0305-7aa3-4164-8eb3-bbd0c607fb6b", "ref-fq-name": ["juniper-mx204"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:45.028 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-56e62d95-92fd-4418-897a-ce5f69ac0ca9', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:45.180 7fad85034240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "0faf287f-e797-4957-81c0-7da2bc124b88", "ref-fq-name": ["juniper-mx240"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:45.180 7fad85034240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "0faf287f-e797-4957-81c0-7da2bc124b88", "ref-fq-name": ["juniper-mx240"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:45.187 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-d38f78fa-27d2-4810-b31b-cc5d27547e82', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:45.342 7fad85451198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "1c588b9c-191d-4d55-b8cc-9f8f31bdb114", "ref-fq-name": ["juniper-mx480"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:45.343 7fad85451198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "1c588b9c-191d-4d55-b8cc-9f8f31bdb114", "ref-fq-name": ["juniper-mx480"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:45.352 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-8b103f6c-2010-4aed-84ee-f01db6b20e9b', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:45.502 7fad8502d780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "6997e820-3114-4ed8-9ab1-454c2c62662b", "ref-fq-name": ["juniper-mx960"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:45.502 7fad8502d780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "6997e820-3114-4ed8-9ab1-454c2c62662b", "ref-fq-name": ["juniper-mx960"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:45.513 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-2e19901e-6992-4b1a-acdf-0b33b64b24f5', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:45.679 7fad855e8a20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "1cfd32b3-9e0b-4fcb-8867-d286f1b64808", "ref-fq-name": ["juniper-mx2008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:45.680 7fad855e8a20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "1cfd32b3-9e0b-4fcb-8867-d286f1b64808", "ref-fq-name": ["juniper-mx2008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:45.694 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-545d71d1-b926-46fa-92f9-ae85397675d5', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:45.721 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:45.858 7fad8502d198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "9a790c45-661c-43c0-a803-68075281ee91", "ref-fq-name": ["juniper-mx2010"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:45.859 7fad8502d198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "9a790c45-661c-43c0-a803-68075281ee91", "ref-fq-name": ["juniper-mx2010"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:45.868 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-1345dfb6-81a9-40cf-9048-528c8afc66f4', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:46.024 7fad850e6eb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "0e2ebd30-ea0d-40c7-8273-dfa397eeb953", "ref-fq-name": ["juniper-mx2020"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:46.025 7fad850e6eb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "0e2ebd30-ea0d-40c7-8273-dfa397eeb953", "ref-fq-name": ["juniper-mx2020"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:46.040 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-718dd718-c2cd-4fdc-8627-3afcec9a6d3a', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:46.198 7fad8515f978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "97b08702-ceaa-4cab-b31f-9865619638b2", "ref-fq-name": ["juniper-mx10003"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:46.199 7fad8515f978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "97b08702-ceaa-4cab-b31f-9865619638b2", "ref-fq-name": ["juniper-mx10003"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:46.219 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-b3853f28-75f1-4fe8-a19e-234783b71262', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:46.368 7fad8545f198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "6c1936b6-39bd-4f45-9b60-e254107e8132", "ref-fq-name": ["juniper-jnp10008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:46.369 7fad8545f198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "6c1936b6-39bd-4f45-9b60-e254107e8132", "ref-fq-name": ["juniper-jnp10008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:46.378 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-4c38a66a-0567-4c31-8edf-7b726005c29b', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:46.533 7fad855e8e10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "d008232c-7864-4e52-8bad-cf746e1c99ef", "ref-fq-name": ["juniper-jnp10016"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:46.533 7fad855e8e10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "d008232c-7864-4e52-8bad-cf746e1c99ef", "ref-fq-name": ["juniper-jnp10016"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:46.563 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-088d5ed7-bb5b-4823-99da-45a75d0c4464', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:46.679 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 06/02/2025 02:08:46.679 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 06/02/2025 02:08:46.679 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 06/02/2025 02:08:46.680 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 06/02/2025 02:08:46.680 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 06/02/2025 02:08:46.680 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 06/02/2025 02:08:46.680 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 06/02/2025 02:08:46.680 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 06/02/2025 02:08:46.680 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 06/02/2025 02:08:46.680 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 06/02/2025 02:08:46.680 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 06/02/2025 02:08:46.680 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 06/02/2025 02:08:46.680 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 06/02/2025 02:08:46.680 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 06/02/2025 02:08:46.680 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 06/02/2025 02:08:46.681 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 06/02/2025 02:08:46.681 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 06/02/2025 02:08:46.681 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 06/02/2025 02:08:46.681 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 06/02/2025 02:08:46.681 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 06/02/2025 02:08:46.681 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 06/02/2025 02:08:46.681 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 06/02/2025 02:08:46.682 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 06/02/2025 02:08:46.682 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 06/02/2025 02:08:46.682 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 06/02/2025 02:08:46.682 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 06/02/2025 02:08:46.683 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 06/02/2025 02:08:46.683 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 06/02/2025 02:08:46.683 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 06/02/2025 02:08:46.683 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 06/02/2025 02:08:46.683 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 06/02/2025 02:08:46.683 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 06/02/2025 02:08:46.683 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 06/02/2025 02:08:46.683 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 06/02/2025 02:08:46.722 7fad853da240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "1e0490d8-6735-461e-9704-53cc5fc31752", "ref-fq-name": ["juniper-vmx"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:46.722 7fad853da240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "hardware", "ref-uuid": "1e0490d8-6735-461e-9704-53cc5fc31752", "ref-fq-name": ["juniper-vmx"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:46.722 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:46.735 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-f42bc63e-1c3f-4c0c-80d8-ccaf37c2bb77', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:46.772 7fad854af630 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:08:46.797 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_routers in resource routing-instance: 'bgp_routers' 06/02/2025 02:08:46.797 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_refs in resource routing-instance: 'routing_instance_refs' 06/02/2025 02:08:46.797 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_target_refs in resource routing-instance: 'route_target_refs' 06/02/2025 02:08:46.797 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource routing-instance: 'tag_refs' 06/02/2025 02:08:46.797 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource routing-instance: 'virtual_machine_interface_back_refs' 06/02/2025 02:08:46.797 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_aggregate_back_refs in resource routing-instance: 'route_aggregate_back_refs' 06/02/2025 02:08:46.797 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_back_refs in resource routing-instance: 'routing_policy_back_refs' 06/02/2025 02:08:46.797 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_back_refs in resource routing-instance: 'routing_instance_back_refs' 06/02/2025 02:08:46.827 7fad854af630 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:08:46.923 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:08:46.923 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:08:46.924 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:08:46.924 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:08:46.924 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:08:46.924 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:08:46.924 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:08:46.924 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:08:46.927 7fad8517cf60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a31a5743-de1c-4da8-ba2a-85832e66d98f object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "a31a5743-de1c-4da8-ba2a-85832e66d98f", "ref-type": "hardware", "ref-uuid": "25b887fa-9931-47be-89a6-34860198beb3", "ref-fq-name": ["juniper-srx5400"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:46.928 7fad8517cf60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a31a5743-de1c-4da8-ba2a-85832e66d98f object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "a31a5743-de1c-4da8-ba2a-85832e66d98f", "ref-type": "hardware", "ref-uuid": "25b887fa-9931-47be-89a6-34860198beb3", "ref-fq-name": ["juniper-srx5400"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:46.940 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-69884e90-9e8b-4cd2-9bf8-60ce870c21f6', 'type': 'node_profile', 'uuid': 'a31a5743-de1c-4da8-ba2a-85832e66d98f'} 06/02/2025 02:08:46.980 7fad8507e198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4d7f2728-37f3-4af7-940e-910aa1e893ed object_type = virtual_router identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/virtual-router/4d7f2728-37f3-4af7-940e-910aa1e893ed operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.129 body = {"virtual-router": {"uuid": "4d7f2728-37f3-4af7-940e-910aa1e893ed", "virtual_router_dpdk_enabled": false}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:46.980 7fad8507e198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4d7f2728-37f3-4af7-940e-910aa1e893ed object_type = virtual_router identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/virtual-router/4d7f2728-37f3-4af7-940e-910aa1e893ed operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.129 body = {"virtual-router": {"uuid": "4d7f2728-37f3-4af7-940e-910aa1e893ed", "virtual_router_dpdk_enabled": false}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:47.018 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'oper': 'UPDATE', 'request-id': 'req-9fa8de5a-d901-4c03-8550-7db3a7403b84', 'type': 'virtual_router', 'uuid': '4d7f2728-37f3-4af7-940e-910aa1e893ed'} 06/02/2025 02:08:47.099 7fad854d18d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a31a5743-de1c-4da8-ba2a-85832e66d98f object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "a31a5743-de1c-4da8-ba2a-85832e66d98f", "ref-type": "hardware", "ref-uuid": "328dafdb-1964-49ca-a3f4-8c8845d75ec0", "ref-fq-name": ["juniper-srx5600"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:47.099 7fad854d18d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a31a5743-de1c-4da8-ba2a-85832e66d98f object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "a31a5743-de1c-4da8-ba2a-85832e66d98f", "ref-type": "hardware", "ref-uuid": "328dafdb-1964-49ca-a3f4-8c8845d75ec0", "ref-fq-name": ["juniper-srx5600"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:47.114 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-baf8afbb-0e27-4a29-9958-27c47d5dfe62', 'type': 'node_profile', 'uuid': 'a31a5743-de1c-4da8-ba2a-85832e66d98f'} 06/02/2025 02:08:47.116 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:08:47.116 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:08:47.117 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:08:47.117 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:08:47.117 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:08:47.117 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:08:47.117 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:08:47.117 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:08:47.230 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_object_refs in resource virtual-machine-interface: 'security_logging_object_refs' 06/02/2025 02:08:47.230 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_refs in resource virtual-machine-interface: 'qos_config_refs' 06/02/2025 02:08:47.231 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_group_refs in resource virtual-machine-interface: 'security_group_refs' 06/02/2025 02:08:47.231 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_refs in resource virtual-machine-interface: 'virtual_machine_interface_refs' 06/02/2025 02:08:47.231 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-machine-interface: 'virtual_machine_refs' 06/02/2025 02:08:47.231 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource virtual-machine-interface: 'bgp_router_refs' 06/02/2025 02:08:47.231 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field port_tuple_refs in resource virtual-machine-interface: 'port_tuple_refs' 06/02/2025 02:08:47.231 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_health_check_refs in resource virtual-machine-interface: 'service_health_check_refs' 06/02/2025 02:08:47.231 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field interface_route_table_refs in resource virtual-machine-interface: 'interface_route_table_refs' 06/02/2025 02:08:47.231 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_interface_refs in resource virtual-machine-interface: 'physical_interface_refs' 06/02/2025 02:08:47.231 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bridge_domain_refs in resource virtual-machine-interface: 'bridge_domain_refs' 06/02/2025 02:08:47.232 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_endpoint_refs in resource virtual-machine-interface: 'service_endpoint_refs' 06/02/2025 02:08:47.232 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_port_group_refs in resource virtual-machine-interface: 'virtual_port_group_refs' 06/02/2025 02:08:47.232 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field port_profile_refs in resource virtual-machine-interface: 'port_profile_refs' 06/02/2025 02:08:47.232 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-machine-interface: 'tag_refs' 06/02/2025 02:08:47.232 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource virtual-machine-interface: 'virtual_machine_interface_back_refs' 06/02/2025 02:08:47.232 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-machine-interface: 'instance_ip_back_refs' 06/02/2025 02:08:47.232 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field subnet_back_refs in resource virtual-machine-interface: 'subnet_back_refs' 06/02/2025 02:08:47.232 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field floating_ip_back_refs in resource virtual-machine-interface: 'floating_ip_back_refs' 06/02/2025 02:08:47.233 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alias_ip_back_refs in resource virtual-machine-interface: 'alias_ip_back_refs' 06/02/2025 02:08:47.233 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field logical_interface_back_refs in resource virtual-machine-interface: 'logical_interface_back_refs' 06/02/2025 02:08:47.233 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_as_a_service_back_refs in resource virtual-machine-interface: 'bgp_as_a_service_back_refs' 06/02/2025 02:08:47.233 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field customer_attachment_back_refs in resource virtual-machine-interface: 'customer_attachment_back_refs' 06/02/2025 02:08:47.233 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field logical_router_back_refs in resource virtual-machine-interface: 'logical_router_back_refs' 06/02/2025 02:08:47.233 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field loadbalancer_pool_back_refs in resource virtual-machine-interface: 'loadbalancer_pool_back_refs' 06/02/2025 02:08:47.233 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_ip_back_refs in resource virtual-machine-interface: 'virtual_ip_back_refs' 06/02/2025 02:08:47.233 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field loadbalancer_back_refs in resource virtual-machine-interface: 'loadbalancer_back_refs' 06/02/2025 02:08:47.234 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_port_group_back_refs in resource virtual-machine-interface: 'virtual_port_group_back_refs' 06/02/2025 02:08:47.234 7fad8515f978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field link_aggregation_group_back_refs in resource virtual-machine-interface: 'link_aggregation_group_back_refs' 06/02/2025 02:08:47.270 7fad84e47588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a31a5743-de1c-4da8-ba2a-85832e66d98f object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "a31a5743-de1c-4da8-ba2a-85832e66d98f", "ref-type": "hardware", "ref-uuid": "1e6a59a0-bad4-47cb-8a27-a5c39572b08a", "ref-fq-name": ["juniper-srx4600"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:47.270 7fad84e47588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a31a5743-de1c-4da8-ba2a-85832e66d98f object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "a31a5743-de1c-4da8-ba2a-85832e66d98f", "ref-type": "hardware", "ref-uuid": "1e6a59a0-bad4-47cb-8a27-a5c39572b08a", "ref-fq-name": ["juniper-srx4600"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:47.280 7fad855688d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:47.280 7fad855688d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:47.280 7fad855688d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:47.280 7fad855688d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:47.280 7fad855688d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:47.280 7fad855688d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:47.280 7fad855688d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 elements = { display_name : "cn-jenkins-deploy-platform-juju-os-542-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 5584225116653570807, "uuid_lslong": 10668624042139358189}, "enable": true, "created": "2025-06-02T02:08:28.867250", "last_modified": "2025-06-02T02:08:47.004034", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3b45d35b-de57-4285-b542-427e524b5c84"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "4d7f2728-37f3-4af7-940e-910aa1e893ed"virtual_router_dpdk_enabled : falsevirtual_router_ip_address : "10.0.0.129" } deleted = False >> 06/02/2025 02:08:47.281 7fad855688d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:47.281 7fad855688d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:47.281 7fad855688d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:47.281 7fad855688d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:47.281 7fad855688d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:47.281 7fad855688d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:47.281 7fad855688d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:47.281 7fad855688d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:08:47.281 7fad855688d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:47.284 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-97668c4f-8478-4fa9-9c55-ccfe6981d81e', 'type': 'node_profile', 'uuid': 'a31a5743-de1c-4da8-ba2a-85832e66d98f'} 06/02/2025 02:08:47.300 7fad8515f978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3077a9a4-a1c3-4cfc-8623-a386a3ad95db object_type = virtual_machine_interface identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1:vhost0 url = https://10.0.0.129:8082/virtual-machine-interface/3077a9a4-a1c3-4cfc-8623-a386a3ad95db operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.129 body = {"virtual-machine-interface": {"uuid": "3077a9a4-a1c3-4cfc-8623-a386a3ad95db", "virtual_machine_interface_disable_policy": true}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:47.342 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-542-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-344795ed-d1d4-4312-9ded-4b795b1e734b', 'type': 'virtual_machine_interface', 'uuid': '3077a9a4-a1c3-4cfc-8623-a386a3ad95db'} 06/02/2025 02:08:47.361 7fad854d52e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:47.361 7fad854d52e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-542-1:vhost0 elements = { display_name : "vhost0"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-542-1", "vhost0"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3492446560602770684, "uuid_lslong": 9665749023934223835}, "enable": true, "created": "2025-06-02T02:08:29.200507", "last_modified": "2025-06-02T02:08:47.326426", "description": null, "user_visible": true, "creator": null}parent_type : "virtual-router"parent_uuid : "4d7f2728-37f3-4af7-940e-910aa1e893ed"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}routing_instance_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "ip-fabric"], "attr": {"direction": "both", "vlan_tag": null, "src_mac": null, "dst_mac": null, "mpls_label": null, "service_chain_address": null, "ipv6_service_chain_address": null, "protocol": null}, "uuid": "4439bfb8-6651-482b-a1c3-f5e57eb0f0f9"}]uuid : "3077a9a4-a1c3-4cfc-8623-a386a3ad95db"virtual_machine_interface_disable_policy : truevirtual_machine_interface_mac_addresses : {"mac_address": ["02:30:77:a9:a4:a1"]}virtual_network_refs : [{"to": ["default-domain", "default-project", "ip-fabric"], "attr": null, "uuid": "e321a686-481b-40eb-913d-c368c1a2c12e"}] } deleted = False >> 06/02/2025 02:08:47.361 7fad854d52e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:47.442 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a31a5743-de1c-4da8-ba2a-85832e66d98f object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "a31a5743-de1c-4da8-ba2a-85832e66d98f", "ref-type": "hardware", "ref-uuid": "60c4161d-877a-4f98-a771-df4538c76998", "ref-fq-name": ["juniper-srx4100"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:47.449 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-58ad1a6b-edb8-4278-8a7f-87d1732ff45e', 'type': 'node_profile', 'uuid': 'a31a5743-de1c-4da8-ba2a-85832e66d98f'} 06/02/2025 02:08:47.473 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:08:47.473 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:08:47.473 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:08:47.473 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:08:47.473 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:08:47.473 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:08:47.473 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:08:47.473 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:08:47.603 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a31a5743-de1c-4da8-ba2a-85832e66d98f object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "a31a5743-de1c-4da8-ba2a-85832e66d98f", "ref-type": "hardware", "ref-uuid": "61f82243-aa07-4da3-9e53-bc38278ae158", "ref-fq-name": ["juniper-srx1500"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:47.622 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-4a11c8e2-305e-42a5-870c-9268599d8338', 'type': 'node_profile', 'uuid': 'a31a5743-de1c-4da8-ba2a-85832e66d98f'} 06/02/2025 02:08:47.723 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:47.771 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a31a5743-de1c-4da8-ba2a-85832e66d98f object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "a31a5743-de1c-4da8-ba2a-85832e66d98f", "ref-type": "hardware", "ref-uuid": "ce599f75-8ac5-4d50-be5d-44d572ce6738", "ref-fq-name": ["juniper-srx240h-poe"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:47.781 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-b4a6353b-5beb-4727-bccc-59ee2c9d5d00', 'type': 'node_profile', 'uuid': 'a31a5743-de1c-4da8-ba2a-85832e66d98f'} 06/02/2025 02:08:47.937 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a31a5743-de1c-4da8-ba2a-85832e66d98f object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "a31a5743-de1c-4da8-ba2a-85832e66d98f", "ref-type": "hardware", "ref-uuid": "1fc454cb-c40f-4d6c-97ea-5c064a2657e0", "ref-fq-name": ["juniper-vsrx"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:47.945 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-67edb359-c220-48ac-808f-71a18ee80003', 'type': 'node_profile', 'uuid': 'a31a5743-de1c-4da8-ba2a-85832e66d98f'} 06/02/2025 02:08:48.102 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a31a5743-de1c-4da8-ba2a-85832e66d98f object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "a31a5743-de1c-4da8-ba2a-85832e66d98f", "ref-type": "hardware", "ref-uuid": "cf240705-dec4-4603-8966-6a1e6b715826", "ref-fq-name": ["juniper-srx5800"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:48.114 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-6962c847-04dd-4504-9f96-c7810f110253', 'type': 'node_profile', 'uuid': 'a31a5743-de1c-4da8-ba2a-85832e66d98f'} 06/02/2025 02:08:48.266 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a31a5743-de1c-4da8-ba2a-85832e66d98f object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "a31a5743-de1c-4da8-ba2a-85832e66d98f", "ref-type": "hardware", "ref-uuid": "4c20374f-163c-4b22-a34a-b6fe1dd8dfbe", "ref-fq-name": ["juniper-srx4200"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:48.273 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-6ccd6e32-bcd1-4808-9d31-5228c915b34a', 'type': 'node_profile', 'uuid': 'a31a5743-de1c-4da8-ba2a-85832e66d98f'} 06/02/2025 02:08:48.421 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b996a442-cf9b-4ff5-ad86-5ab6196a9651 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "b996a442-cf9b-4ff5-ad86-5ab6196a9651", "ref-type": "physical-role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:48.436 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-c4ab3869-b4ce-4878-bf2a-b341885a333a', 'type': 'node_profile', 'uuid': 'b996a442-cf9b-4ff5-ad86-5ab6196a9651'} 06/02/2025 02:08:48.584 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b996a442-cf9b-4ff5-ad86-5ab6196a9651 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "b996a442-cf9b-4ff5-ad86-5ab6196a9651", "ref-type": "overlay-role", "ref-uuid": "287bad2a-fdd1-45a7-aa65-ddc815d80c5c", "ref-fq-name": ["default-global-system-config", "erb-ucast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:48.593 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-8330f102-6085-4cf1-8428-a758389a5e21', 'type': 'node_profile', 'uuid': 'b996a442-cf9b-4ff5-ad86-5ab6196a9651'} 06/02/2025 02:08:48.724 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:48.738 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "overlay-role", "ref-uuid": "287bad2a-fdd1-45a7-aa65-ddc815d80c5c", "ref-fq-name": ["default-global-system-config", "erb-ucast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:48.748 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-191e9b48-b3f5-48b9-b627-8f17f9e16cc9', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:48.898 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5994f3e4-4c95-42ab-84e1-a7bca2c5a68e object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "5994f3e4-4c95-42ab-84e1-a7bca2c5a68e", "ref-type": "job_template", "ref-uuid": "b8323ee2-6e57-4175-aa4d-6a010a387da1", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:48.906 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-1ccbbc86-29e2-4b99-959a-db09986d19bf', 'type': 'node_profile', 'uuid': '5994f3e4-4c95-42ab-84e1-a7bca2c5a68e'} 06/02/2025 02:08:49.048 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b996a442-cf9b-4ff5-ad86-5ab6196a9651 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "b996a442-cf9b-4ff5-ad86-5ab6196a9651", "ref-type": "job_template", "ref-uuid": "b8323ee2-6e57-4175-aa4d-6a010a387da1", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:49.057 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-f7d64fbe-a420-4ae6-8d8d-b19e75992e82', 'type': 'node_profile', 'uuid': 'b996a442-cf9b-4ff5-ad86-5ab6196a9651'} 06/02/2025 02:08:49.208 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 82179eeb-03ff-442c-8c9c-fae35cd36588 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "82179eeb-03ff-442c-8c9c-fae35cd36588", "ref-type": "job_template", "ref-uuid": "b8323ee2-6e57-4175-aa4d-6a010a387da1", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:49.217 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-f2e2155e-ba64-4147-8692-129ce7cfce59', 'type': 'node_profile', 'uuid': '82179eeb-03ff-442c-8c9c-fae35cd36588'} 06/02/2025 02:08:49.365 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37e33153-3de9-449e-9fee-e4efdcb9d440 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5220 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "37e33153-3de9-449e-9fee-e4efdcb9d440", "ref-type": "job_template", "ref-uuid": "b8323ee2-6e57-4175-aa4d-6a010a387da1", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:49.376 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-5a4b8865-992c-4509-b535-904dfb8ca2ef', 'type': 'node_profile', 'uuid': '37e33153-3de9-449e-9fee-e4efdcb9d440'} 06/02/2025 02:08:49.520 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e5731a99-e81d-4044-8c64-b1da863ad0ae object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k-lean url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "e5731a99-e81d-4044-8c64-b1da863ad0ae", "ref-type": "job_template", "ref-uuid": "b8323ee2-6e57-4175-aa4d-6a010a387da1", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:49.533 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'oper': 'UPDATE', 'request-id': 'req-1607975b-83b3-45d9-8dad-732466fd751d', 'type': 'node_profile', 'uuid': 'e5731a99-e81d-4044-8c64-b1da863ad0ae'} 06/02/2025 02:08:49.676 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9", "ref-type": "job_template", "ref-uuid": "b8323ee2-6e57-4175-aa4d-6a010a387da1", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:49.684 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-dec1626d-19ff-451d-b9b8-36c93c3ec54f', 'type': 'node_profile', 'uuid': 'e7b5eb0d-26fe-4d56-9d4a-2156cd0ccab9'} 06/02/2025 02:08:49.725 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:49.832 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1dda3a7b-1747-4cd4-894a-e4811a09b749 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "1dda3a7b-1747-4cd4-894a-e4811a09b749", "ref-type": "job_template", "ref-uuid": "b8323ee2-6e57-4175-aa4d-6a010a387da1", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:49.842 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-9d00130f-5480-4cb5-8c84-06f444e061f7', 'type': 'node_profile', 'uuid': '1dda3a7b-1747-4cd4-894a-e4811a09b749'} 06/02/2025 02:08:49.984 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a31a5743-de1c-4da8-ba2a-85832e66d98f object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "node-profile", "uuid": "a31a5743-de1c-4da8-ba2a-85832e66d98f", "ref-type": "job_template", "ref-uuid": "b8323ee2-6e57-4175-aa4d-6a010a387da1", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:49.995 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-02742d4c-22e4-4704-98d7-b5ac3ae246f1', 'type': 'node_profile', 'uuid': 'a31a5743-de1c-4da8-ba2a-85832e66d98f'} 06/02/2025 02:08:50.146 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d64efc0f-dba4-4715-aba0-f9c8e2583fcc object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-1 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "telemetry-profile", "uuid": "d64efc0f-dba4-4715-aba0-f9c8e2583fcc", "ref-type": "sflow-profile", "ref-uuid": "d8bc1ad7-469d-46b6-8a81-eca7e34b19fb", "ref-fq-name": ["default-domain", "default-project", "sflow-all-interfaces"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:50.159 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'oper': 'UPDATE', 'request-id': 'req-c102726f-8533-44cd-be44-1ad7fd56a14d', 'type': 'telemetry_profile', 'uuid': 'd64efc0f-dba4-4715-aba0-f9c8e2583fcc'} 06/02/2025 02:08:50.308 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a74c68ab-5273-4139-97de-1107782b035c object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-2 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "telemetry-profile", "uuid": "a74c68ab-5273-4139-97de-1107782b035c", "ref-type": "sflow-profile", "ref-uuid": "ddc0f737-d917-4ce5-8023-aab9801827db", "ref-fq-name": ["default-domain", "default-project", "sflow-fabric-interfaces"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:50.318 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'oper': 'UPDATE', 'request-id': 'req-e9283dcb-b157-4ae6-9d82-239371c22bc6', 'type': 'telemetry_profile', 'uuid': 'a74c68ab-5273-4139-97de-1107782b035c'} 06/02/2025 02:08:50.461 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e668ae2d-0e42-4027-8570-8fe445ad2a46 object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-3 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "telemetry-profile", "uuid": "e668ae2d-0e42-4027-8570-8fe445ad2a46", "ref-type": "sflow-profile", "ref-uuid": "e3bc93c5-fbfc-4008-90bd-fa944938dee8", "ref-fq-name": ["default-domain", "default-project", "sflow-access-interfaces"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:50.473 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'oper': 'UPDATE', 'request-id': 'req-75987500-4f7e-4e7f-9089-45d9c6aa7164', 'type': 'telemetry_profile', 'uuid': 'e668ae2d-0e42-4027-8570-8fe445ad2a46'} 06/02/2025 02:08:50.626 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8ce8eecb-975b-419d-9d14-81481c7dff2c object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-4 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "telemetry-profile", "uuid": "8ce8eecb-975b-419d-9d14-81481c7dff2c", "ref-type": "grpc-profile", "ref-uuid": "005c2cc9-2c10-497a-9e21-dcc7abfc0566", "ref-fq-name": ["default-domain", "default-project", "grpc-default-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:50.639 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'oper': 'UPDATE', 'request-id': 'req-41409bd4-85ad-493f-ac62-06234727c570', 'type': 'telemetry_profile', 'uuid': '8ce8eecb-975b-419d-9d14-81481c7dff2c'} 06/02/2025 02:08:50.727 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:50.783 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5b273cac-ef3c-4251-ab99-9fbf873e7c89 object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-5 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "telemetry-profile", "uuid": "5b273cac-ef3c-4251-ab99-9fbf873e7c89", "ref-type": "snmp-profile", "ref-uuid": "67b3fb73-68ee-4c7a-a9ae-e31712b37031", "ref-fq-name": ["default-domain", "default-project", "snmp-default-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:50.797 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'oper': 'UPDATE', 'request-id': 'req-c21c2372-344b-42a3-9143-9dbb87b48940', 'type': 'telemetry_profile', 'uuid': '5b273cac-ef3c-4251-ab99-9fbf873e7c89'} 06/02/2025 02:08:50.941 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 663443bf-7ab8-4e96-a733-075d1b9632bd object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-6 url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "telemetry-profile", "uuid": "663443bf-7ab8-4e96-a733-075d1b9632bd", "ref-type": "netconf-profile", "ref-uuid": "8607a0d4-fd28-4d90-ab84-dc1ec636281f", "ref-fq-name": ["default-domain", "default-project", "netconf-default-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:50.955 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'oper': 'UPDATE', 'request-id': 'req-641ce1a0-f004-4aa3-bbab-d39c511bbcc8', 'type': 'telemetry_profile', 'uuid': '663443bf-7ab8-4e96-a733-075d1b9632bd'} 06/02/2025 02:08:51.099 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7118d799-926c-4778-941a-c155233ef33c object_type = device_functional_group identifier_name = default-domain:default-project:L2-Server-Leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "7118d799-926c-4778-941a-c155233ef33c", "ref-type": "physical_role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:51.109 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-073f41b2-42ea-42c9-a226-4cb5302932a8', 'type': 'device_functional_group', 'uuid': '7118d799-926c-4778-941a-c155233ef33c'} 06/02/2025 02:08:51.260 7fad85fee048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8fe6caa7-b00a-4d5f-b532-824d61932441 object_type = device_functional_group identifier_name = default-domain:default-project:L3-Storage-Leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "8fe6caa7-b00a-4d5f-b532-824d61932441", "ref-type": "physical_role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:51.270 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-c419fc3f-a2c4-4351-88bf-b5333bdee19f', 'type': 'device_functional_group', 'uuid': '8fe6caa7-b00a-4d5f-b532-824d61932441'} 06/02/2025 02:08:51.280 7fad853dac18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:51.416 7fad85192198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4bcce432-070f-4797-8285-ee756adde250 object_type = device_functional_group identifier_name = default-domain:default-project:L3-Gateway-Spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "4bcce432-070f-4797-8285-ee756adde250", "ref-type": "physical_role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:51.417 7fad85192198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4bcce432-070f-4797-8285-ee756adde250 object_type = device_functional_group identifier_name = default-domain:default-project:L3-Gateway-Spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "4bcce432-070f-4797-8285-ee756adde250", "ref-type": "physical_role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:51.428 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'oper': 'UPDATE', 'request-id': 'req-807b7a8b-b46c-49ea-b667-cfd8e9b614cb', 'type': 'device_functional_group', 'uuid': '4bcce432-070f-4797-8285-ee756adde250'} 06/02/2025 02:08:51.573 7fad84eb9f60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1f1ae8a8-1a4c-496d-9293-4b19bfdebaae object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "1f1ae8a8-1a4c-496d-9293-4b19bfdebaae", "ref-type": "physical_role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:51.573 7fad84eb9f60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1f1ae8a8-1a4c-496d-9293-4b19bfdebaae object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "1f1ae8a8-1a4c-496d-9293-4b19bfdebaae", "ref-type": "physical_role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:51.582 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'oper': 'UPDATE', 'request-id': 'req-641b39a2-23a8-4b3a-9f69-31e8ac514e02', 'type': 'device_functional_group', 'uuid': '1f1ae8a8-1a4c-496d-9293-4b19bfdebaae'} 06/02/2025 02:08:51.729 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:51.732 7fad854c1e10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1ec50229-5e33-4879-bf55-e80eddbf0cb5 object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "1ec50229-5e33-4879-bf55-e80eddbf0cb5", "ref-type": "physical_role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:51.732 7fad854c1e10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1ec50229-5e33-4879-bf55-e80eddbf0cb5 object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "1ec50229-5e33-4879-bf55-e80eddbf0cb5", "ref-type": "physical_role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:51.743 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'oper': 'UPDATE', 'request-id': 'req-574817a3-ff85-4852-a2ca-68c1a0a654fc', 'type': 'device_functional_group', 'uuid': '1ec50229-5e33-4879-bf55-e80eddbf0cb5'} 06/02/2025 02:08:51.894 7fad85602438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c3c5d841-fcfa-45e5-84ae-7f17f8a3c7a5 object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "c3c5d841-fcfa-45e5-84ae-7f17f8a3c7a5", "ref-type": "physical_role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:51.894 7fad85602438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c3c5d841-fcfa-45e5-84ae-7f17f8a3c7a5 object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "c3c5d841-fcfa-45e5-84ae-7f17f8a3c7a5", "ref-type": "physical_role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:51.902 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'oper': 'UPDATE', 'request-id': 'req-5a955138-2aa6-495b-bb49-d2284006a8ac', 'type': 'device_functional_group', 'uuid': 'c3c5d841-fcfa-45e5-84ae-7f17f8a3c7a5'} 06/02/2025 02:08:52.044 7fad8583bcc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1822f736-6b22-4cae-8d2f-90b9cda970f8 object_type = device_functional_group identifier_name = default-domain:default-project:Border-Spine-in-Edge-Routed url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "1822f736-6b22-4cae-8d2f-90b9cda970f8", "ref-type": "physical_role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:52.045 7fad8583bcc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1822f736-6b22-4cae-8d2f-90b9cda970f8 object_type = device_functional_group identifier_name = default-domain:default-project:Border-Spine-in-Edge-Routed url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "1822f736-6b22-4cae-8d2f-90b9cda970f8", "ref-type": "physical_role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:52.056 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'oper': 'UPDATE', 'request-id': 'req-132af97d-0bf9-495a-a51a-4eb07c501605', 'type': 'device_functional_group', 'uuid': '1822f736-6b22-4cae-8d2f-90b9cda970f8'} 06/02/2025 02:08:52.201 7fad84e54198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 72b573e0-0a5c-45e5-beef-c073ff327508 object_type = device_functional_group identifier_name = default-domain:default-project:Border-Leaf-in-Edge-Routed url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "72b573e0-0a5c-45e5-beef-c073ff327508", "ref-type": "physical_role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:52.202 7fad84e54198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 72b573e0-0a5c-45e5-beef-c073ff327508 object_type = device_functional_group identifier_name = default-domain:default-project:Border-Leaf-in-Edge-Routed url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "72b573e0-0a5c-45e5-beef-c073ff327508", "ref-type": "physical_role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:52.211 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'oper': 'UPDATE', 'request-id': 'req-fb6a2a14-b472-43df-9c30-9aad8c98efcf', 'type': 'device_functional_group', 'uuid': '72b573e0-0a5c-45e5-beef-c073ff327508'} 06/02/2025 02:08:52.356 7fad8583be10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d105a7d8-056f-44d7-82f8-b8a8c7553a8c object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "d105a7d8-056f-44d7-82f8-b8a8c7553a8c", "ref-type": "physical_role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:52.356 7fad8583be10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d105a7d8-056f-44d7-82f8-b8a8c7553a8c object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "d105a7d8-056f-44d7-82f8-b8a8c7553a8c", "ref-type": "physical_role", "ref-uuid": "9bd3718b-0a55-4a76-b1e7-dc58702a4394", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:52.365 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-b356720f-d55d-41d0-879a-7f0f908b0668', 'type': 'device_functional_group', 'uuid': 'd105a7d8-056f-44d7-82f8-b8a8c7553a8c'} 06/02/2025 02:08:52.509 7fad84f68390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2082e336-64e2-4877-9172-d8fe95bdd485 object_type = device_functional_group identifier_name = default-domain:default-project:Lean-Spine-with-Route-Reflector url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "2082e336-64e2-4877-9172-d8fe95bdd485", "ref-type": "physical_role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:52.509 7fad84f68390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2082e336-64e2-4877-9172-d8fe95bdd485 object_type = device_functional_group identifier_name = default-domain:default-project:Lean-Spine-with-Route-Reflector url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"type": "device-functional-group", "uuid": "2082e336-64e2-4877-9172-d8fe95bdd485", "ref-type": "physical_role", "ref-uuid": "20956987-e065-43f1-b18f-4cd11deea055", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:52.520 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'oper': 'UPDATE', 'request-id': 'req-6781527a-a37c-421f-bb91-8aa6d9735f01', 'type': 'device_functional_group', 'uuid': '2082e336-64e2-4877-9172-d8fe95bdd485'} 06/02/2025 02:08:52.567 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'] not found in DB: Unknown id: network_ipam default-domain:default-project:_internal_ipam_ipv6_link_local 06/02/2025 02:08:52.572 7fad84f38240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = network_ipam identifier_name = default-domain:default-project:_internal_ipam_ipv6_link_local url = https://10.0.0.129:8082/network-ipams operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"network-ipam": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "parent_type": "project", "ipam_subnet_method": "user-defined-subnet", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_ipam_ipv6_link_local"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:52.572 7fad84f38240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = network_ipam identifier_name = default-domain:default-project:_internal_ipam_ipv6_link_local url = https://10.0.0.129:8082/network-ipams operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"network-ipam": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "parent_type": "project", "ipam_subnet_method": "user-defined-subnet", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_ipam_ipv6_link_local"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:52.602 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'obj_dict': {'display_name': '_internal_ipam_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'id_perms': {'created': '2025-06-02T02:08:52.591215', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:52.591215', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13312213641307216212, 'uuid_mslong': 18315836879606730035}}, 'ipam_subnet_method': 'user-defined-subnet', 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fe2eec99-bcf5-4d33-b8be-7bc69039d954'}, 'oper': 'CREATE', 'request-id': 'req-ee043e14-9c9f-4933-bf68-30238676d904', 'type': 'network_ipam', 'uuid': 'fe2eec99-bcf5-4d33-b8be-7bc69039d954'} 06/02/2025 02:08:52.645 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'] not found in DB: Unknown id: virtual_network default-domain:default-project:_internal_vn_ipv6_link_local 06/02/2025 02:08:52.649 7fad84f3c0f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_network identifier_name = default-domain:default-project:_internal_vn_ipv6_link_local url = https://10.0.0.129:8082/virtual-networks operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"virtual-network": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_vn_ipv6_link_local"], "parent_type": "project", "address_allocation_mode": "user-defined-subnet-only", "network_ipam_refs": [{"to": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "fe80::", "ip_prefix_len": 64}, "default_gateway": "fe80::1", "dns_server_address": null, "subnet_uuid": "87be3b10-3f56-11f0-99cb-76fafadcd1c7", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": null, "alloc_unit": 1, "created": null, "last_modified": null, "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "fe2eec99-bcf5-4d33-b8be-7bc69039d954"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_vn_ipv6_link_local"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:52.650 7fad84f3c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_network identifier_name = default-domain:default-project:_internal_vn_ipv6_link_local url = https://10.0.0.129:8082/virtual-networks operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-device-manager remote_ip = 10.0.0.129 body = {"virtual-network": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_vn_ipv6_link_local"], "parent_type": "project", "address_allocation_mode": "user-defined-subnet-only", "network_ipam_refs": [{"to": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "fe80::", "ip_prefix_len": 64}, "default_gateway": "fe80::1", "dns_server_address": null, "subnet_uuid": "87be3b10-3f56-11f0-99cb-76fafadcd1c7", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": null, "alloc_unit": 1, "created": null, "last_modified": null, "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "fe2eec99-bcf5-4d33-b8be-7bc69039d954"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_vn_ipv6_link_local"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:52.730 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:52.889 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'], 'obj_dict': {'address_allocation_mode': 'user-defined-subnet-only', 'display_name': '_internal_vn_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'], 'id_perms': {'created': '2025-06-02T02:08:52.834647', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:52.834647', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9955088696347321635, 'uuid_mslong': 14192177610413523605}}, 'is_shared': False, 'network_ipam_refs': [{'attr': {'host_routes': None, 'ipam_subnets': [{'addr_from_start': True, 'alloc_unit': 1, 'allocation_pools': [], 'created': None, 'default_gateway': 'fe80::1', 'dhcp_option_list': None, 'dhcp_relay_server': [], 'dns_nameservers': [], 'dns_server_address': 'fe80::2', 'enable_dhcp': True, 'host_routes': None, 'last_modified': None, 'subnet': {'ip_prefix': 'fe80::', 'ip_prefix_len': 64}, 'subnet_name': None, 'subnet_uuid': '87be3b10-3f56-11f0-99cb-76fafadcd1c7', 'subscriber_tag': None, 'vlan_tag': None}]}, 'to': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'uuid': 'fe2eec99-bcf5-4d33-b8be-7bc69039d954'}], 'parent_type': 'project', 'parent_uuid': '313b637a-6515-43a9-a5b8-6d420f327024', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c4f4be57-e1f3-4295-8a27-946ccd49e523', 'virtual_network_network_id': 5}, 'oper': 'CREATE', 'request-id': 'req-36098e60-dced-4603-bdd6-570561e9bce4', 'type': 'virtual_network', 'uuid': 'c4f4be57-e1f3-4295-8a27-946ccd49e523'} 06/02/2025 02:08:52.890 7fad868f0e10 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 06/02/2025 02:08:52.897 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'] not found in DB: Unknown id: routing_instance default-domain:default-project:_internal_vn_ipv6_link_local:_internal_vn_ipv6_link_local 06/02/2025 02:08:52.902 7fad868cb198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = routing_instance identifier_name = default-domain:default-project:_internal_vn_ipv6_link_local:_internal_vn_ipv6_link_local url = http://127.0.0.1/routing-instances operation = post body = {"routing-instance": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_vn_ipv6_link_local", "_internal_vn_ipv6_link_local"], "parent_type": "virtual-network", "routing_instance_is_default": true, "routing_instance_has_pnf": false, "routing_instance_fabric_snat": false, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_vn_ipv6_link_local"}} domain = default-domain >> 06/02/2025 02:08:52.902 7fad868cb198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = routing_instance identifier_name = default-domain:default-project:_internal_vn_ipv6_link_local:_internal_vn_ipv6_link_local url = http://127.0.0.1/routing-instances operation = post body = {"routing-instance": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_vn_ipv6_link_local", "_internal_vn_ipv6_link_local"], "parent_type": "virtual-network", "routing_instance_is_default": true, "routing_instance_has_pnf": false, "routing_instance_fabric_snat": false, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_vn_ipv6_link_local"}} domain = default-domain >> 06/02/2025 02:08:53.054 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'obj_dict': {'display_name': '_internal_vn_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'id_perms': {'created': '2025-06-02T02:08:53.041392', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:53.041392', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12523307202293390346, 'uuid_mslong': 1732025902730792887}}, 'parent_type': 'virtual-network', 'parent_uuid': 'c4f4be57-e1f3-4295-8a27-946ccd49e523', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '18096461-c20b-4fb7-adcb-b98c95c9dc0a'}, 'oper': 'CREATE', 'request-id': 'req-36098e60-dced-4603-bdd6-570561e9bce4', 'type': 'routing_instance', 'uuid': '18096461-c20b-4fb7-adcb-b98c95c9dc0a'} 06/02/2025 02:08:53.312 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabric_namespaces in resource fabric: 'fabric_namespaces' 06/02/2025 02:08:53.312 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_port_groups in resource fabric: 'virtual_port_groups' 06/02/2025 02:08:53.312 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_map_refs in resource fabric: 'intent_map_refs' 06/02/2025 02:08:53.312 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_network_refs in resource fabric: 'virtual_network_refs' 06/02/2025 02:08:53.312 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profile_refs in resource fabric: 'node_profile_refs' 06/02/2025 02:08:53.312 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource fabric: 'tag_refs' 06/02/2025 02:08:53.313 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field logical_router_back_refs in resource fabric: 'logical_router_back_refs' 06/02/2025 02:08:53.313 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnect_back_refs in resource fabric: 'data_center_interconnect_back_refs' 06/02/2025 02:08:53.313 7fad85fee048 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource fabric: 'physical_router_back_refs' 06/02/2025 02:08:53.421 7fad88a75cc0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['target:64512:8000004'] not found in DB: Unknown id: route_target target:64512:8000004 06/02/2025 02:08:53.422 7fad8544b8d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000004 url = https://10.0.0.129:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000004"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000004"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:53.423 7fad8544b8d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000004 url = https://10.0.0.129:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000004"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b5ccb5b0fb284bceb910d21866a8a172", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000004"}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:53.439 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['target:64512:8000004'], 'obj_dict': {'display_name': 'target:64512:8000004', 'fq_name': ['target:64512:8000004'], 'id_perms': {'created': '2025-06-02T02:08:53.430907', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-02T02:08:53.430907', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12805137875255575439, 'uuid_mslong': 14241808908544134861}}, 'perms2': {'global_access': 0, 'owner': 'b5ccb5b0fb284bceb910d21866a8a172', 'owner_access': 7, 'share': []}, 'uuid': 'c5a511be-f8c4-4ecd-b1b4-fd0d9282438f'}, 'oper': 'CREATE', 'request-id': 'req-54781a78-782f-47cc-9f1d-9358aa089147', 'type': 'route_target', 'uuid': 'c5a511be-f8c4-4ecd-b1b4-fd0d9282438f'} 06/02/2025 02:08:53.453 7fad84f466d8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 18096461-c20b-4fb7-adcb-b98c95c9dc0a object_type = routing_instance identifier_name = default-domain:default-project:_internal_vn_ipv6_link_local:_internal_vn_ipv6_link_local url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"type": "routing-instance", "uuid": "18096461-c20b-4fb7-adcb-b98c95c9dc0a", "ref-type": "route-target", "ref-uuid": "c5a511be-f8c4-4ecd-b1b4-fd0d9282438f", "ref-fq-name": ["target:64512:8000004"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:53.453 7fad84f466d8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 18096461-c20b-4fb7-adcb-b98c95c9dc0a object_type = routing_instance identifier_name = default-domain:default-project:_internal_vn_ipv6_link_local:_internal_vn_ipv6_link_local url = https://10.0.0.129:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-542-1:/usr/local/bin/contrail-schema remote_ip = 10.0.0.129 body = {"type": "routing-instance", "uuid": "18096461-c20b-4fb7-adcb-b98c95c9dc0a", "ref-type": "route-target", "ref-uuid": "c5a511be-f8c4-4ecd-b1b4-fd0d9282438f", "ref-fq-name": ["target:64512:8000004"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 06/02/2025 02:08:53.468 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'oper': 'UPDATE', 'request-id': 'req-34ef14f6-5bb6-41b3-beac-9d5cf4687b1f', 'type': 'routing_instance', 'uuid': '18096461-c20b-4fb7-adcb-b98c95c9dc0a'} 06/02/2025 02:08:53.731 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:54.733 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:55.735 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:56.282 7fad853dac18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:56.282 7fad853dac18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:56.282 7fad853dac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:56.283 7fad853dac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:56.283 7fad853dac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:56.283 7fad853dac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:56.283 7fad853dac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:_internal_vn_ipv6_link_local elements = { address_allocation_mode : "user-defined-subnet-only"display_name : "_internal_vn_ipv6_link_local"fq_name : ["default-domain", "default-project", "_internal_vn_ipv6_link_local"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 14192177610413523605, "uuid_lslong": 9955088696347321635}, "enable": true, "created": "2025-06-02T02:08:52.834647", "last_modified": "2025-06-02T02:08:52.834647", "description": null, "user_visible": true, "creator": null}is_shared : falsenetwork_ipam_refs : [{"to": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "fe80::", "ip_prefix_len": 64}, "default_gateway": "fe80::1", "dns_server_address": "fe80::2", "subnet_uuid": "87be3b10-3f56-11f0-99cb-76fafadcd1c7", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": null, "alloc_unit": 1, "created": null, "last_modified": null, "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "fe2eec99-bcf5-4d33-b8be-7bc69039d954"}]parent_type : "project"parent_uuid : "313b637a-6515-43a9-a5b8-6d420f327024"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "c4f4be57-e1f3-4295-8a27-946ccd49e523"virtual_network_network_id : 5 } deleted = False >> 06/02/2025 02:08:56.283 7fad853dac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:56.283 7fad853dac18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:56.284 7fad853dac18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:56.284 7fad853dac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:56.284 7fad853dac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:56.284 7fad853dac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:56.284 7fad853dac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:56.284 7fad853dac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:08:56.284 7fad853dac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:56.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:57.205 7fad854b3780 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:08:57.259 7fad854b3780 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:08:57.739 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:58.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:08:59.741 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:00.283 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:00.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:01.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:02.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:03.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:04.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:05.286 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:05.286 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:05.286 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:05.286 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:05.286 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:05.286 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:05.287 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:05.287 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:05.287 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:05.287 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:05.287 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:05.287 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:09:05.287 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:05.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:06.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:07.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:08.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:09.287 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:09.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:11.718 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:12.720 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:13.721 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:14.290 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:14.290 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:14.290 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:14.290 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:14.290 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:14.290 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:14.291 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:14.291 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:14.291 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:14.291 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:14.291 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:14.291 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:09:14.291 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:14.723 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:15.724 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:16.725 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:17.728 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:18.291 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:18.729 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:19.731 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:20.733 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:21.734 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:22.736 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:23.295 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:23.295 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:23.295 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:23.296 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:23.296 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:23.296 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:23.296 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:23.296 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:23.297 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:23.297 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:23.297 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:23.297 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:09:23.297 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:23.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:24.739 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:25.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:26.741 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:27.296 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:27.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:28.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:29.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:30.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:31.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:32.298 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:32.298 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:32.298 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:32.298 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:32.298 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:32.298 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:32.299 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:32.299 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:32.299 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:32.299 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:32.299 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:32.299 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:09:32.299 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:32.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:33.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:34.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:35.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:36.298 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:36.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:37.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:38.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:39.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:41.301 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:41.301 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:41.301 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:41.301 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:41.301 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:41.301 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:41.302 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:41.302 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:41.302 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:41.302 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:41.302 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:41.302 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:09:41.302 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:41.719 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:42.720 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:43.722 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:44.723 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:45.302 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:45.725 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:46.726 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:47.728 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:48.554 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:09:48.554 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:09:48.554 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:09:48.555 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:09:48.555 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:09:48.555 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:09:48.555 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:09:48.555 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:09:48.729 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:49.731 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:50.304 7fad84eb9e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:50.304 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:50.304 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:50.304 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:50.305 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:50.305 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:50.305 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:50.305 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:50.305 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:50.305 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:50.305 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:50.305 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:09:50.305 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:50.733 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:51.734 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:52.736 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:53.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:54.304 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:54.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:55.741 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:56.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:57.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:58.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:09:59.307 7fad84eb9e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:59.307 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:59.307 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:59.308 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:59.308 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:59.308 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:59.308 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:59.308 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:59.309 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:59.309 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:59.309 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:59.309 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:09:59.309 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:59.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:00.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:01.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:02.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:03.308 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:03.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:04.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:05.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:06.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:07.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:08.311 7fad84eb9e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:08.311 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:08.311 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:08.311 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:08.311 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:08.312 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:08.312 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:08.312 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:08.313 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:08.313 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:08.313 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:08.313 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:10:08.313 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:08.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:09.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:11.720 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:12.312 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:12.722 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:13.723 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:14.725 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:15.726 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:16.728 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:17.314 7fad84eb9e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:17.314 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:17.314 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:17.314 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:17.314 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:17.314 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:17.315 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:17.315 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:17.315 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:17.315 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:17.315 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:17.315 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:10:17.315 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:17.729 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:18.182 7fad84eb9e10 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:10:18.239 7fad84eb9e10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:10:18.730 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:19.731 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:20.732 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:21.314 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:21.733 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:22.735 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:23.736 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:24.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:25.738 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:26.317 7fad84eb9e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:26.317 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:26.317 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:26.317 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:26.317 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:26.317 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:26.318 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:26.318 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:26.318 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:26.318 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:26.318 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:26.318 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:10:26.318 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:26.739 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:27.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:28.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:28.877 7fad84eb9e10 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:10:28.930 7fad84eb9e10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:10:29.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:30.317 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:30.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:31.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:32.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:33.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:34.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:35.320 7fad84eb9e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:35.320 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:35.320 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:35.321 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:35.321 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:35.321 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:35.322 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:35.322 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:35.322 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:35.322 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:35.322 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:35.322 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:10:35.322 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:35.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:36.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:37.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:38.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:39.320 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:39.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:41.721 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:42.723 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:43.725 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:44.323 7fad84eb9e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:44.323 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:44.323 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:44.323 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:44.323 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:44.323 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:44.324 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:44.324 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:44.325 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:44.325 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:44.325 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:44.325 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:10:44.325 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:44.726 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:45.728 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:46.729 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:47.731 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:48.324 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:48.732 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:48.933 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 06/02/2025 02:10:48.934 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 06/02/2025 02:10:48.934 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 06/02/2025 02:10:48.934 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 06/02/2025 02:10:48.934 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 06/02/2025 02:10:48.934 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 06/02/2025 02:10:48.934 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 06/02/2025 02:10:48.934 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 06/02/2025 02:10:48.934 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 06/02/2025 02:10:48.935 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 06/02/2025 02:10:48.935 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 06/02/2025 02:10:48.935 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 06/02/2025 02:10:48.935 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 06/02/2025 02:10:48.935 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 06/02/2025 02:10:48.935 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 06/02/2025 02:10:48.935 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 06/02/2025 02:10:48.935 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 06/02/2025 02:10:48.935 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 06/02/2025 02:10:48.935 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 06/02/2025 02:10:48.935 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 06/02/2025 02:10:48.935 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 06/02/2025 02:10:48.935 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 06/02/2025 02:10:48.936 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 06/02/2025 02:10:48.936 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 06/02/2025 02:10:48.936 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 06/02/2025 02:10:48.936 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 06/02/2025 02:10:48.936 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 06/02/2025 02:10:48.936 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 06/02/2025 02:10:48.936 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 06/02/2025 02:10:48.936 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 06/02/2025 02:10:48.936 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 06/02/2025 02:10:48.936 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 06/02/2025 02:10:48.937 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 06/02/2025 02:10:48.937 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 06/02/2025 02:10:49.037 7fad8535a6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource config-node: 'tag_refs' 06/02/2025 02:10:49.562 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:10:49.562 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:10:49.562 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:10:49.562 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:10:49.562 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:10:49.562 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:10:49.562 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:10:49.562 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:10:49.734 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:50.735 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:51.735 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:52.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:53.326 7fad84eb9e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:53.326 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:53.326 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:53.327 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:53.327 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:53.327 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:53.327 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:53.327 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:53.327 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:53.328 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:53.328 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:53.328 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:10:53.328 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:53.738 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:54.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:55.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:56.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:57.327 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:57.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:58.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:59.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:10:59.965 7fad85352a20 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:11:00.010 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_routers in resource routing-instance: 'bgp_routers' 06/02/2025 02:11:00.010 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_refs in resource routing-instance: 'routing_instance_refs' 06/02/2025 02:11:00.010 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_target_refs in resource routing-instance: 'route_target_refs' 06/02/2025 02:11:00.010 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource routing-instance: 'tag_refs' 06/02/2025 02:11:00.011 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource routing-instance: 'virtual_machine_interface_back_refs' 06/02/2025 02:11:00.011 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_aggregate_back_refs in resource routing-instance: 'route_aggregate_back_refs' 06/02/2025 02:11:00.011 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_back_refs in resource routing-instance: 'routing_policy_back_refs' 06/02/2025 02:11:00.011 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_back_refs in resource routing-instance: 'routing_instance_back_refs' 06/02/2025 02:11:00.022 7fad85352a20 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:11:00.163 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zone_refs in resource bgp-router: 'control_node_zone_refs' 06/02/2025 02:11:00.163 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource bgp-router: 'sub_cluster_refs' 06/02/2025 02:11:00.163 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource bgp-router: 'bgp_router_refs' 06/02/2025 02:11:00.163 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource bgp-router: 'tag_refs' 06/02/2025 02:11:00.163 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource bgp-router: 'physical_router_back_refs' 06/02/2025 02:11:00.163 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource bgp-router: 'virtual_machine_interface_back_refs' 06/02/2025 02:11:00.164 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_as_a_service_back_refs in resource bgp-router: 'bgp_as_a_service_back_refs' 06/02/2025 02:11:00.164 7fad84f60240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_back_refs in resource bgp-router: 'bgp_router_back_refs' 06/02/2025 02:11:00.216 7fad855c9c18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 118cdf23-919f-48f4-b894-9e396fb2d92c object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/bgp-router/118cdf23-919f-48f4-b894-9e396fb2d92c operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.129 body = {"bgp-router": {"uuid": "118cdf23-919f-48f4-b894-9e396fb2d92c", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.0.0.129", "address": "10.0.0.129", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:11:00.216 7fad855c9c18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 118cdf23-919f-48f4-b894-9e396fb2d92c object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-542-1 url = https://10.0.0.129:8082/bgp-router/118cdf23-919f-48f4-b894-9e396fb2d92c operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-542-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.129 body = {"bgp-router": {"uuid": "118cdf23-919f-48f4-b894-9e396fb2d92c", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.0.0.129", "address": "10.0.0.129", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}}} domain = default-domain project = admin user = admin >> 06/02/2025 02:11:00.232 7fad868f0e10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-juju-os-542-1'], 'oper': 'UPDATE', 'request-id': 'req-8d999d32-2f70-4bb8-b4cd-183a385b7552', 'type': 'bgp_router', 'uuid': '118cdf23-919f-48f4-b894-9e396fb2d92c'} 06/02/2025 02:11:00.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:01.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:02.329 7fad84eb9e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:02.330 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:02.330 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:02.330 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:02.330 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:02.330 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:02.330 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.0.0.129", "address": "10.0.0.129", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-juju-os-542-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-juju-os-542-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "member", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 1264630939244251380, "uuid_lslong": 13300429569056233772}, "enable": true, "created": "2025-06-02T02:07:42.809933", "last_modified": "2025-06-02T02:11:00.224108", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "5db59199-8d09-4071-9fea-ae1610ec70e7"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "118cdf23-919f-48f4-b894-9e396fb2d92c" } deleted = False >> 06/02/2025 02:11:02.330 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:02.330 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:02.331 7fad84eb9e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:02.331 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:02.331 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:02.331 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:02.331 7fad84eb9e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:02.331 7fad84eb9e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:11:02.331 7fad84eb9e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:02.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:03.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:04.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:05.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:06.330 7fad854afc18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:06.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:07.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:08.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:09.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:11.333 7fad854afc18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:11.333 7fad854afc18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:11.333 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:11.333 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:11.333 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:11.333 7fad854afc18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:11.335 7fad854afc18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:11.335 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:11.335 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:11.335 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:11.335 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:11.335 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:11:11.335 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:11.722 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:12.723 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:13.725 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:14.726 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:15.334 7fad854afc18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:15.727 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:16.729 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:17.730 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:18.731 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:19.733 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:20.336 7fad854afc18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:20.336 7fad854afc18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:20.336 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:20.336 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:20.336 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:20.336 7fad854afc18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:20.337 7fad854afc18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:20.337 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:20.337 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:20.337 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:20.337 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:20.337 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:11:20.337 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:20.734 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:21.735 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:22.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:23.738 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:24.336 7fad854afc18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:24.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:25.741 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:26.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:27.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:28.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:29.339 7fad854afc18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:29.339 7fad854afc18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:29.339 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:29.339 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:29.339 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:29.339 7fad854afc18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:29.340 7fad854afc18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:29.340 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:29.340 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:29.340 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:29.340 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:29.340 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:11:29.340 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:29.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:30.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:31.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:32.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:33.339 7fad854afc18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:33.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:34.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:35.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:36.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:37.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:38.342 7fad854afc18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:38.342 7fad854afc18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:38.343 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:38.343 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:38.343 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:38.343 7fad854afc18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:38.343 7fad854afc18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:38.343 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:38.343 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:38.344 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:38.344 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:38.344 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:11:38.344 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:38.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:39.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:41.723 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:42.343 7fad854afc18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:42.725 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:43.726 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:44.727 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:45.729 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:46.730 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:47.346 7fad854afc18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:47.346 7fad854afc18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:47.346 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:47.346 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:47.346 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:47.346 7fad854afc18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:47.347 7fad854afc18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:47.347 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:47.347 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:47.347 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:47.347 7fad854afc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:47.347 7fad854afc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:11:47.348 7fad854afc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:47.732 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:48.733 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:49.734 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:50.327 7fad855ca198 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:11:50.377 7fad84f2d8d0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:11:50.537 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:11:50.537 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:11:50.537 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:11:50.537 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:11:50.538 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:11:50.538 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:11:50.538 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:11:50.538 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:11:50.736 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:51.347 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:51.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:52.738 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:53.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:54.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:55.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:56.349 7fad84f41e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:56.350 7fad84f41e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:56.351 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:56.351 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:56.351 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:56.351 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:56.352 7fad84f41e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:56.352 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:56.352 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:56.352 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:56.352 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:56.352 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:11:56.353 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:56.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:57.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:58.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:11:59.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:00.350 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:00.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:01.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:02.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:03.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:04.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:05.352 7fad84f41e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:05.353 7fad84f41e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:05.353 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:05.353 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:05.353 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:05.353 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:05.354 7fad84f41e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:05.354 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:05.354 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:05.354 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:05.354 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:05.354 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:12:05.354 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:05.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:06.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:07.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:08.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:09.353 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:09.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:11.729 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:12.731 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:13.732 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:14.358 7fad84f41e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:14.358 7fad84f41e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:14.358 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:14.358 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:14.358 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:14.358 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:14.359 7fad84f41e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:14.359 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:14.359 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:14.359 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:14.359 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:14.359 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:12:14.359 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:14.734 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:15.741 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:16.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:17.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:18.359 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:18.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:19.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:20.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:21.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:22.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:23.366 7fad84f41e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:23.366 7fad84f41e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:23.366 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:23.366 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:23.367 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:23.367 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:23.367 7fad84f41e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:23.368 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:23.368 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:23.368 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:23.368 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:23.368 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:12:23.369 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:23.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:24.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:25.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:26.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:27.367 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:27.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:28.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:29.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:30.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:31.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:32.369 7fad84f41e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:32.369 7fad84f41e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:32.369 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:32.369 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:32.369 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:32.369 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:32.370 7fad84f41e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:32.370 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:32.370 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:32.370 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:32.370 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:32.370 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:12:32.370 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:32.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:33.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:34.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:35.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:36.370 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:36.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:37.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:38.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:39.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:41.373 7fad84f41e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:41.373 7fad84f41e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:41.373 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:41.373 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:41.373 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:41.373 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:41.374 7fad84f41e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:41.374 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:41.374 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:41.374 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:41.374 7fad84f41e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:41.374 7fad84f41e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:12:41.374 7fad84f41e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:41.727 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:42.729 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:43.730 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:44.731 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:45.373 7fad85601438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:45.732 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:46.734 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:47.735 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:48.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:49.738 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:50.376 7fad85601438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:50.376 7fad85601438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:50.376 7fad85601438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:50.377 7fad85601438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:50.377 7fad85601438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:50.377 7fad85601438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:50.377 7fad85601438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:50.378 7fad85601438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:50.378 7fad85601438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:50.378 7fad85601438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:50.378 7fad85601438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:50.378 7fad85601438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:12:50.378 7fad85601438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:50.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:51.495 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:12:51.495 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:12:51.495 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:12:51.495 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:12:51.495 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:12:51.496 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:12:51.496 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:12:51.496 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:12:51.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:52.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:53.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:54.376 7fad84bd8d68 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:54.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:55.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:56.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:57.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:58.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:12:59.378 7fad84bd8d68 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:59.379 7fad84bd8d68 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:59.379 7fad84bd8d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:59.379 7fad84bd8d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:59.379 7fad84bd8d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:59.379 7fad84bd8d68 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:59.380 7fad84bd8d68 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:59.380 7fad84bd8d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:59.380 7fad84bd8d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:59.380 7fad84bd8d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:59.380 7fad84bd8d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:59.381 7fad84bd8d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:12:59.381 7fad84bd8d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:59.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:00.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:01.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:02.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:03.379 7fad84bd8d68 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:03.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:04.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:05.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:06.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:07.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:08.382 7fad84bd8d68 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:08.382 7fad84bd8d68 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:08.382 7fad84bd8d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:08.382 7fad84bd8d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:08.382 7fad84bd8d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:08.382 7fad84bd8d68 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:08.383 7fad84bd8d68 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:08.383 7fad84bd8d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:08.383 7fad84bd8d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:08.383 7fad84bd8d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:08.383 7fad84bd8d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:08.383 7fad84bd8d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:13:08.383 7fad84bd8d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:08.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:09.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:11.728 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:12.382 7fad855642e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:12.730 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:13.732 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:14.733 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:15.734 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:16.736 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:17.385 7fad855642e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:17.385 7fad855642e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:17.386 7fad855642e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:17.386 7fad855642e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:17.386 7fad855642e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:17.386 7fad855642e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:17.387 7fad855642e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:17.387 7fad855642e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:17.387 7fad855642e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:17.387 7fad855642e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:17.387 7fad855642e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:17.387 7fad855642e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:13:17.388 7fad855642e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:17.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:18.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:19.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:20.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:21.386 7fad855642e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:21.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:22.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:23.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:24.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:25.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:26.390 7fad855642e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:26.390 7fad855642e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:26.390 7fad855642e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:26.390 7fad855642e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:26.390 7fad855642e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:26.390 7fad855642e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:26.391 7fad855642e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:26.391 7fad855642e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:26.391 7fad855642e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:26.391 7fad855642e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:26.391 7fad855642e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:26.391 7fad855642e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:13:26.391 7fad855642e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:26.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:27.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:28.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:29.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:30.391 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:30.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:31.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:32.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:33.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:34.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:35.393 7fad84e3fb70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:35.393 7fad84e3fb70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:35.393 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:35.393 7fad84e3fb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:35.394 7fad84e3fb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:35.394 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:35.394 7fad84e3fb70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:35.394 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:35.395 7fad84e3fb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:35.395 7fad84e3fb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:35.395 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:35.395 7fad84e3fb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:13:35.395 7fad84e3fb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:35.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:36.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:37.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:38.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:39.394 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:39.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:41.730 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:42.732 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:43.733 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:44.397 7fad84e3fb70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:44.397 7fad84e3fb70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:44.397 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:44.397 7fad84e3fb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:44.397 7fad84e3fb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:44.397 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:44.398 7fad84e3fb70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:44.398 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:44.398 7fad84e3fb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:44.398 7fad84e3fb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:44.398 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:44.398 7fad84e3fb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:13:44.398 7fad84e3fb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:44.734 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:45.736 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:46.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:47.738 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:48.398 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:48.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:49.741 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:50.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:51.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:52.449 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:13:52.449 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:13:52.449 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:13:52.449 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:13:52.449 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:13:52.449 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:13:52.449 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:13:52.450 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:13:52.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:53.400 7fad84e3fb70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:53.400 7fad84e3fb70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:53.400 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:53.401 7fad84e3fb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:53.401 7fad84e3fb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:53.401 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:53.401 7fad84e3fb70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:53.402 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:53.402 7fad84e3fb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:53.402 7fad84e3fb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:53.402 7fad84e3fb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:53.402 7fad84e3fb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:13:53.402 7fad84e3fb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:53.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:54.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:55.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:56.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:57.400 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:57.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:58.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:13:59.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:00.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:01.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:02.402 7fad84b786d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:02.403 7fad84b786d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:02.403 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:02.403 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:02.403 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:02.403 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:02.404 7fad84b786d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:02.404 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:02.404 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:02.404 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:02.404 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:02.404 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:14:02.404 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:02.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:03.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:04.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:05.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:06.404 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:06.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:07.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:08.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:09.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:11.406 7fad84b786d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:11.406 7fad84b786d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:11.406 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:11.406 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:11.406 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:11.407 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:11.407 7fad84b786d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:11.407 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:11.407 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:11.407 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:11.407 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:11.408 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:14:11.408 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:11.731 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:12.733 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:13.734 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:14.735 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:15.407 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:15.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:16.738 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:17.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:18.741 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:19.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:20.410 7fad84b786d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:20.410 7fad84b786d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:20.410 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:20.410 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:20.410 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:20.410 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:20.411 7fad84b786d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:20.411 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:20.411 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:20.411 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:20.411 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:20.411 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:14:20.412 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:20.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:21.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:22.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:23.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:24.411 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:24.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:25.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:26.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:27.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:28.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:29.413 7fad84b786d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:29.414 7fad84b786d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:29.414 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:29.414 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:29.414 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:29.414 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:29.415 7fad84b786d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:29.415 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:29.415 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:29.416 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:29.416 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:29.416 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:14:29.416 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:29.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:30.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:31.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:32.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:33.415 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:33.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:34.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:35.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:36.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:37.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:38.417 7fad84b786d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:38.418 7fad84b786d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:38.418 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:38.418 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:38.418 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:38.418 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:38.419 7fad84b786d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:38.419 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:38.419 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:38.419 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:38.419 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:38.419 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:14:38.420 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:38.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:39.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:41.731 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:42.418 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:42.733 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:43.734 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:44.736 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:45.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:46.739 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:47.420 7fad84b786d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:47.421 7fad84b786d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:47.421 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:47.421 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:47.421 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:47.421 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:47.422 7fad84b786d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:47.422 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:47.422 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:47.422 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:47.422 7fad84b786d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:47.422 7fad84b786d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:14:47.422 7fad84b786d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:47.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:48.741 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:49.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:50.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:51.421 7fad853d80f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:51.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:52.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:53.399 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:14:53.400 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:14:53.400 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:14:53.400 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:14:53.400 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:14:53.400 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:14:53.400 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:14:53.400 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:14:53.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:54.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:55.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:56.424 7fad853d80f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:56.424 7fad853d80f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:56.424 7fad853d80f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:56.424 7fad853d80f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:56.424 7fad853d80f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:56.424 7fad853d80f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:56.425 7fad853d80f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:56.425 7fad853d80f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:56.425 7fad853d80f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:56.425 7fad853d80f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:56.425 7fad853d80f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:56.425 7fad853d80f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:14:56.425 7fad853d80f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:56.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:57.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:58.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:14:59.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:00.424 7fad853d80f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:00.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:01.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:02.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:03.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:04.377 7fad85224438 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:15:04.434 7fad85568a20 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:15:04.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:05.427 7fad853d80f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:05.428 7fad853d80f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:05.428 7fad853d80f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:05.428 7fad853d80f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:05.428 7fad853d80f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:05.428 7fad853d80f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:05.429 7fad853d80f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:05.429 7fad853d80f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:05.429 7fad853d80f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:05.429 7fad853d80f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:05.429 7fad853d80f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:05.429 7fad853d80f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:15:05.429 7fad853d80f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:05.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:06.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:07.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:08.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:09.429 7fad85c64240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:09.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:11.733 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:12.735 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:13.735 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:14.431 7fad85c64240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:14.432 7fad85c64240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:14.432 7fad85c64240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:14.432 7fad85c64240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:14.432 7fad85c64240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:14.432 7fad85c64240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:14.433 7fad85c64240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:14.433 7fad85c64240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:14.433 7fad85c64240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:14.434 7fad85c64240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:14.434 7fad85c64240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:14.434 7fad85c64240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:15:14.434 7fad85c64240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:14.699 7fad85c64240 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:15:14.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:14.753 7fad85c64240 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:15:15.739 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:16.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:17.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:18.433 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:18.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:19.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:20.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:21.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:22.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:23.435 7fad8545ad68 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:23.436 7fad8545ad68 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:23.436 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:23.436 7fad8545ad68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:23.436 7fad8545ad68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:23.436 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:23.437 7fad8545ad68 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:23.437 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:23.437 7fad8545ad68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:23.437 7fad8545ad68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:23.437 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:23.438 7fad8545ad68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:15:23.438 7fad8545ad68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:23.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:24.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:25.441 7fad8545ad68 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:15:25.493 7fad8545ad68 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:15:25.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:26.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:27.436 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:27.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:28.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:29.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:30.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:31.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:32.438 7fad8545ad68 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:32.439 7fad8545ad68 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:32.439 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:32.439 7fad8545ad68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:32.439 7fad8545ad68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:32.439 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:32.440 7fad8545ad68 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:32.440 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:32.440 7fad8545ad68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:32.440 7fad8545ad68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:32.440 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:32.440 7fad8545ad68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:15:32.440 7fad8545ad68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:32.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:33.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:34.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:35.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:36.440 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:36.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:37.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:38.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:39.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:41.442 7fad8545ad68 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:41.443 7fad8545ad68 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:41.443 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:41.443 7fad8545ad68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:41.443 7fad8545ad68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:41.443 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:41.443 7fad8545ad68 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:41.444 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:41.444 7fad8545ad68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:41.444 7fad8545ad68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:41.444 7fad8545ad68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:41.444 7fad8545ad68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:15:41.444 7fad8545ad68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:41.734 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:42.735 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:43.736 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:44.738 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:45.444 7fad85352e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:45.739 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:46.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:47.741 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:48.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:49.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:50.447 7fad85352e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:50.447 7fad85352e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:50.448 7fad85352e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:50.448 7fad85352e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:50.448 7fad85352e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:50.448 7fad85352e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:50.448 7fad85352e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:50.448 7fad85352e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:50.449 7fad85352e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:50.449 7fad85352e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:50.449 7fad85352e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:50.449 7fad85352e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:15:50.449 7fad85352e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:50.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:51.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:52.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:53.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:54.355 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:15:54.356 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:15:54.356 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:15:54.356 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:15:54.356 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:15:54.356 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:15:54.356 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:15:54.356 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:15:54.447 7fad84e440f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:54.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:55.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:56.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:57.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:58.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:15:59.450 7fad84e440f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:59.450 7fad84e440f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:59.450 7fad84e440f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:59.450 7fad84e440f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:59.451 7fad84e440f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:59.451 7fad84e440f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:59.451 7fad84e440f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:59.451 7fad84e440f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:59.451 7fad84e440f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:59.452 7fad84e440f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:59.452 7fad84e440f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:59.452 7fad84e440f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:15:59.452 7fad84e440f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:59.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:00.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:01.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:02.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:03.451 7fad84e440f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:03.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:04.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:05.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:06.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:07.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:08.453 7fad84e440f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:08.454 7fad84e440f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:08.454 7fad84e440f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:08.454 7fad84e440f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:08.454 7fad84e440f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:08.454 7fad84e440f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:08.455 7fad84e440f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:08.455 7fad84e440f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:08.455 7fad84e440f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:08.455 7fad84e440f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:08.455 7fad84e440f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:08.455 7fad84e440f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:16:08.455 7fad84e440f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:08.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:09.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:11.735 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:12.454 7fad85178048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:12.736 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:13.738 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:14.739 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:15.741 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:16.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:17.456 7fad85178048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:17.457 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:17.457 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:17.457 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:17.457 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:17.457 7fad85178048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:17.458 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:17.458 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:17.458 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:17.458 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:17.458 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:17.458 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:16:17.458 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:17.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:18.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:19.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:20.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:21.458 7fad85178048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:21.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:22.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:23.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:24.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:25.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:26.460 7fad85178048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:26.460 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:26.460 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:26.460 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:26.461 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:26.461 7fad85178048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:26.461 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:26.461 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:26.461 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:26.461 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:26.462 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:26.462 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:16:26.462 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:26.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:27.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:28.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:29.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:30.461 7fad84b78828 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:30.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:31.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:32.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:33.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:34.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:35.462 7fad84b78828 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:35.463 7fad84b78828 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:35.463 7fad84b78828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:35.463 7fad84b78828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:35.463 7fad84b78828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:35.463 7fad84b78828 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:35.463 7fad84b78828 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:35.464 7fad84b78828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:35.464 7fad84b78828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:35.464 7fad84b78828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:35.464 7fad84b78828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:35.464 7fad84b78828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:16:35.464 7fad84b78828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:35.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:36.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:37.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:38.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:39.464 7fad84b78828 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:39.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:41.736 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:42.738 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:43.738 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:44.466 7fad84b78828 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:44.467 7fad84b78828 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:44.467 7fad84b78828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:44.467 7fad84b78828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:44.467 7fad84b78828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:44.467 7fad84b78828 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:44.468 7fad84b78828 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:44.468 7fad84b78828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:44.468 7fad84b78828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:44.468 7fad84b78828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:44.468 7fad84b78828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:44.468 7fad84b78828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:16:44.468 7fad84b78828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:44.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:45.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:46.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:47.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:48.468 7fad84b78828 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:48.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:49.074 7fad84f2dcc0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:16:49.126 7fad84f2dcc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:16:49.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:50.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:51.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:52.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:53.471 7fad84b78828 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:53.471 7fad84b78828 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:53.471 7fad84b78828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:53.471 7fad84b78828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:53.471 7fad84b78828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:53.471 7fad84b78828 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:53.472 7fad84b78828 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:53.472 7fad84b78828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:53.472 7fad84b78828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:53.472 7fad84b78828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:53.472 7fad84b78828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:53.472 7fad84b78828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:16:53.472 7fad84b78828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:53.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:54.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:55.459 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:16:55.459 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:16:55.459 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:16:55.459 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:16:55.460 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:16:55.460 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:16:55.460 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:16:55.460 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:16:55.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:56.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:57.472 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:57.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:58.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:16:59.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:00.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:01.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:02.475 7fad855e6ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:02.475 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:02.475 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:02.475 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:02.475 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:02.475 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:02.476 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:02.476 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:02.476 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:02.476 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:02.476 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:02.476 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:17:02.476 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:02.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:03.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:04.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:05.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:06.476 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:06.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:07.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:08.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:09.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:11.478 7fad855e6ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:11.478 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:11.478 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:11.478 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:11.478 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:11.479 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:11.479 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:11.479 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:11.479 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:11.479 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:11.479 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:11.480 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:17:11.480 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:11.737 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:12.738 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:13.741 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:14.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:15.479 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:15.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:16.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:17.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:18.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:19.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:20.482 7fad855e6ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:20.482 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:20.482 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:20.482 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:20.482 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:20.482 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:20.483 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:20.483 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:20.483 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:20.483 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:20.483 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:20.483 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:17:20.483 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:20.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:21.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:22.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:23.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:24.483 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:24.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:25.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:26.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:27.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:28.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:29.485 7fad855e6ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:29.486 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:29.486 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:29.486 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:29.486 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:29.486 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:29.487 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:29.487 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:29.487 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:29.487 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:29.487 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:29.487 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:17:29.487 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:29.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:30.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:31.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:32.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:33.487 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:33.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:34.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:35.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:36.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:37.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:38.489 7fad855e6ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:38.489 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:38.490 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:38.490 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:38.490 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:38.490 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:38.491 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:38.491 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:38.491 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:38.491 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:38.491 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:38.491 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:17:38.491 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:38.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:39.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:41.738 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:42.490 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:42.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:43.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:44.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:45.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:46.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:47.493 7fad855e6ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:47.493 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:47.493 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:47.493 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:47.493 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:47.493 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:47.494 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:47.494 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:47.494 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:47.494 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:47.494 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:47.494 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:17:47.494 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:47.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:48.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:49.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:50.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:51.493 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:51.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:52.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:53.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:54.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:55.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:56.405 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:17:56.405 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:17:56.405 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:17:56.406 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:17:56.406 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:17:56.406 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:17:56.406 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:17:56.406 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:17:56.495 7fad855e6ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:56.496 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:56.496 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:56.496 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:56.496 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:56.496 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:56.497 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:56.497 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:56.497 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:56.497 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:56.498 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:56.498 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:17:56.498 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:56.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:57.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:58.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:17:59.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:00.496 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:00.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:01.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:02.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:03.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:04.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:05.499 7fad855e6ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:05.499 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:05.500 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:05.500 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:05.500 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:05.500 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:05.501 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:05.501 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:05.501 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:05.501 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:05.501 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:05.501 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:18:05.501 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:05.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:06.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:07.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:08.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:09.500 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:09.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:11.739 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:12.740 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:13.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:14.502 7fad855e6ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:14.503 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:14.503 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:14.503 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:14.503 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:14.503 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:14.504 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:14.504 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:14.504 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:14.504 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:14.504 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:14.504 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:18:14.504 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:14.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:15.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:16.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:17.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:18.504 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:18.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:19.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:20.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:21.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:22.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:23.507 7fad855e6ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:23.507 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:23.507 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:23.508 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:23.508 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:23.508 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:23.508 7fad855e6ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:23.508 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:23.508 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:23.508 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:23.509 7fad855e6ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:23.509 7fad855e6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:18:23.509 7fad855e6ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:23.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:24.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:25.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:26.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:27.507 7fad84e44588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:27.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:28.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:29.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:30.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:31.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:32.510 7fad84e44588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:32.510 7fad84e44588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:32.510 7fad84e44588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:32.510 7fad84e44588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:32.510 7fad84e44588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:32.510 7fad84e44588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:32.511 7fad84e44588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:32.511 7fad84e44588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:32.511 7fad84e44588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:32.511 7fad84e44588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:32.511 7fad84e44588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:32.512 7fad84e44588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:18:32.512 7fad84e44588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:32.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:33.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:34.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:35.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:36.511 7fad84e44588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:36.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:37.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:38.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:39.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:41.515 7fad84e44588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:41.515 7fad84e44588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:41.515 7fad84e44588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:41.515 7fad84e44588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:41.515 7fad84e44588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:41.515 7fad84e44588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:41.516 7fad84e44588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:41.516 7fad84e44588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:41.516 7fad84e44588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:41.516 7fad84e44588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:41.516 7fad84e44588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:41.516 7fad84e44588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:18:41.516 7fad84e44588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:41.739 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:42.741 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:43.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:44.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:45.515 7fad85602048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:45.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:46.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:47.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:48.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:49.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:50.516 7fad85602048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:50.517 7fad85602048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:50.517 7fad85602048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:50.517 7fad85602048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:50.517 7fad85602048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:50.517 7fad85602048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:50.518 7fad85602048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:50.518 7fad85602048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:50.518 7fad85602048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:50.518 7fad85602048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:50.518 7fad85602048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:50.518 7fad85602048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:18:50.518 7fad85602048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:50.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:51.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:52.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:53.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:54.518 7fad85602048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:54.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:55.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:56.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:57.340 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:18:57.340 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:18:57.341 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:18:57.341 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:18:57.341 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:18:57.341 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:18:57.341 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:18:57.341 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:18:57.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:58.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:18:59.521 7fad85602048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:59.521 7fad85602048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:59.521 7fad85602048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:59.522 7fad85602048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:59.522 7fad85602048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:59.522 7fad85602048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:59.522 7fad85602048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:59.523 7fad85602048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:59.523 7fad85602048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:59.523 7fad85602048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:59.523 7fad85602048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:59.523 7fad85602048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:18:59.523 7fad85602048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:59.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:00.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:01.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:02.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:03.521 7fad85602048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:03.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:04.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:05.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:06.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:07.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:08.524 7fad85602048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:08.524 7fad85602048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:08.524 7fad85602048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:08.524 7fad85602048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:08.524 7fad85602048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:08.525 7fad85602048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:08.526 7fad85602048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:08.527 7fad85602048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:08.527 7fad85602048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:08.527 7fad85602048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:08.527 7fad85602048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:08.527 7fad85602048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:19:08.527 7fad85602048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:08.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:09.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:11.741 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:12.525 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:12.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:13.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:14.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:15.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:16.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:17.527 7fad8534f2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:17.527 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:17.527 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:17.527 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:17.527 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:17.527 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:17.528 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:17.528 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:17.528 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:17.528 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:17.529 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:17.529 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:19:17.529 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:17.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:18.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:19.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:20.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:21.528 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:21.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:22.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:23.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:24.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:25.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:26.530 7fad8534f2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:26.531 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:26.531 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:26.531 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:26.531 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:26.531 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:26.531 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:26.532 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:26.532 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:26.532 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:26.532 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:26.532 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:19:26.532 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:26.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:27.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:28.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:29.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:30.532 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:30.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:31.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:32.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:33.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:34.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:35.535 7fad8534f2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:35.535 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:35.535 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:35.536 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:35.536 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:35.536 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:35.536 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:35.536 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:35.536 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:35.536 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:35.536 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:35.536 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:19:35.537 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:35.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:36.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:37.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:38.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:39.537 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:39.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:41.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:42.743 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:43.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:44.538 7fad8534f2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:44.539 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:44.539 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:44.539 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:44.539 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:44.540 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:44.540 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:44.540 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:44.540 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:44.540 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:44.541 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:44.541 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:19:44.541 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:44.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:45.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:46.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:47.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:48.539 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:48.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:49.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:50.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:51.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:52.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:53.541 7fad8534f2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:53.541 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:53.541 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:53.541 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:53.541 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:53.542 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:53.542 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:53.542 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:53.542 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:53.542 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:53.542 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:53.543 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:19:53.543 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:53.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:54.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:55.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:56.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:57.541 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:57.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:58.303 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:19:58.303 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:19:58.303 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:19:58.303 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:19:58.304 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:19:58.304 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:19:58.304 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:19:58.304 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:19:58.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:19:59.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:00.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:01.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:02.543 7fad8534f2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:02.544 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:02.544 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:02.544 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:02.544 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:02.544 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:02.545 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:02.545 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:02.545 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:02.545 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:02.545 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:02.545 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:20:02.546 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:02.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:03.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:04.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:05.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:06.545 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:06.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:07.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:08.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:09.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:11.548 7fad8534f2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:11.548 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:11.548 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:11.548 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:11.548 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:11.549 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:11.549 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:11.549 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:11.549 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:11.549 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:11.549 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:11.549 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:20:11.549 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:11.742 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:12.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:13.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:14.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:15.549 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:15.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:16.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:16.782 7fad84b84e10 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:20:16.833 7fad84b84e10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:20:17.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:18.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:19.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:20.552 7fad8534f2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:20.552 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:20.553 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:20.553 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:20.553 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:20.553 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:20.554 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:20.554 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:20.555 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:20.555 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:20.555 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:20.555 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:20:20.555 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:20.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:21.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:22.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:23.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:24.552 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:24.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:25.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:26.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:27.494 7fad84b8d048 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:20:27.546 7fad84b8d048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:20:27.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:28.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:29.556 7fad8534f2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:29.556 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:29.556 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:29.556 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:29.556 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:29.556 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:29.557 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:29.557 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:29.557 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:29.557 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:29.558 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:29.558 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:20:29.558 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:29.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:30.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:31.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:32.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:33.556 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:33.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:34.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:35.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:36.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:37.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:37.926 7fad84b920f0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:20:37.977 7fad84b920f0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:20:38.564 7fad8534f2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:38.564 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:38.565 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:38.565 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:38.565 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:38.565 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:38.565 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:38.565 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:38.566 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:38.566 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:38.566 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:38.566 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:20:38.566 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:38.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:39.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:41.744 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:42.565 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:42.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:43.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:44.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:45.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:46.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:47.568 7fad8534f2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:47.568 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:47.568 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:47.568 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:47.568 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:47.568 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:47.569 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:47.569 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:47.569 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:47.569 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:47.569 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:47.569 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:20:47.569 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:47.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:48.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:49.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:50.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:51.569 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:51.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:52.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:53.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:54.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:55.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:56.571 7fad8534f2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:56.572 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:56.572 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:56.572 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:56.572 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:56.572 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:56.572 7fad8534f2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:56.573 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:56.573 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:56.573 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:56.573 7fad8534f2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:56.573 7fad8534f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:20:56.573 7fad8534f2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:56.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:57.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:58.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:20:59.285 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:20:59.285 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:20:59.285 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:20:59.285 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:20:59.285 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:20:59.285 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:20:59.285 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:20:59.285 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:20:59.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:00.572 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:00.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:01.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:02.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:03.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:04.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:05.574 7fad84ba3e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:05.575 7fad84ba3e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:05.575 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:05.575 7fad84ba3e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:05.575 7fad84ba3e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:05.575 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:05.576 7fad84ba3e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:05.576 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:05.576 7fad84ba3e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:05.577 7fad84ba3e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:05.577 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:05.577 7fad84ba3e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:21:05.577 7fad84ba3e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:05.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:06.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:07.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:08.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:09.576 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:09.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:11.745 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:12.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:13.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:14.579 7fad84ba3e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:14.580 7fad84ba3e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:14.580 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:14.580 7fad84ba3e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:14.580 7fad84ba3e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:14.580 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:14.581 7fad84ba3e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:14.581 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:14.581 7fad84ba3e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:14.581 7fad84ba3e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:14.581 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:14.581 7fad84ba3e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:21:14.581 7fad84ba3e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:14.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:15.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:16.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:17.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:18.580 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:18.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:19.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:20.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:21.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:22.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:23.582 7fad84ba3e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:23.583 7fad84ba3e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:23.583 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:23.583 7fad84ba3e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:23.583 7fad84ba3e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:23.583 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:23.583 7fad84ba3e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:23.584 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:23.584 7fad84ba3e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:23.584 7fad84ba3e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:23.584 7fad84ba3e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:23.584 7fad84ba3e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:21:23.584 7fad84ba3e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:23.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:24.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:25.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:26.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:27.587 7fad84e44390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:27.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:28.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:29.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:30.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:31.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:32.590 7fad84e44390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:32.590 7fad84e44390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:32.591 7fad84e44390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:32.591 7fad84e44390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:32.591 7fad84e44390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:32.591 7fad84e44390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:32.591 7fad84e44390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:32.592 7fad84e44390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:32.592 7fad84e44390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:32.592 7fad84e44390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:32.592 7fad84e44390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:32.592 7fad84e44390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:21:32.592 7fad84e44390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:32.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:33.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:34.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:35.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:36.590 7fad84e44390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:36.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:37.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:38.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:39.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:41.594 7fad84e44390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:41.594 7fad84e44390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:41.594 7fad84e44390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:41.594 7fad84e44390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:41.594 7fad84e44390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:41.595 7fad84e44390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:41.595 7fad84e44390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:41.595 7fad84e44390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:41.595 7fad84e44390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:41.595 7fad84e44390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:41.595 7fad84e44390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:41.596 7fad84e44390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:21:41.596 7fad84e44390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:41.746 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:42.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:43.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:44.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:45.596 7fad84b30438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:45.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:46.474 7fad84ba5f60 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:21:46.528 7fad850576d8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:21:46.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:47.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:48.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:49.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:50.598 7fad84b30438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:50.598 7fad84b30438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:50.599 7fad84b30438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:50.599 7fad84b30438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:50.599 7fad84b30438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:50.599 7fad84b30438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:50.599 7fad84b30438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:50.600 7fad84b30438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:50.600 7fad84b30438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:50.600 7fad84b30438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:50.600 7fad84b30438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:50.600 7fad84b30438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:21:50.600 7fad84b30438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:50.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:51.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:52.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:53.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:54.599 7fad84bdbd68 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:54.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:55.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:56.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:57.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:58.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:21:59.602 7fad84bdbd68 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:59.602 7fad84bdbd68 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:59.602 7fad84bdbd68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:59.603 7fad84bdbd68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:59.603 7fad84bdbd68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:59.603 7fad84bdbd68 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:59.603 7fad84bdbd68 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:59.603 7fad84bdbd68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:59.604 7fad84bdbd68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:59.604 7fad84bdbd68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:59.604 7fad84bdbd68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:59.604 7fad84bdbd68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:21:59.604 7fad84bdbd68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:59.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:00.257 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:22:00.257 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:22:00.257 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:22:00.258 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:22:00.258 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:22:00.258 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:22:00.258 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:22:00.258 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:22:00.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:01.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:02.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:03.604 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:03.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:04.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:05.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:06.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:07.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:08.606 7fad84b46e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:08.606 7fad84b46e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:08.606 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:08.607 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:08.607 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:08.607 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:08.607 7fad84b46e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:08.607 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:08.608 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:08.608 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:08.608 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:08.608 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:22:08.608 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:08.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:09.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:11.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:12.607 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:12.748 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:13.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:14.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:15.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:16.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:17.609 7fad84b46e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:17.609 7fad84b46e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:17.609 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:17.609 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:17.610 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:17.610 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:17.610 7fad84b46e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:17.610 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:17.611 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:17.611 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:17.611 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:17.611 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:22:17.611 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:17.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:18.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:19.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:20.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:21.610 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:21.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:22.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:23.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:24.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:25.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:26.612 7fad84b46e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:26.612 7fad84b46e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:26.612 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:26.613 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:26.613 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:26.613 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:26.613 7fad84b46e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:26.613 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:26.613 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:26.614 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:26.614 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:26.614 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:22:26.614 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:26.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:27.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:28.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:29.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:30.613 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:30.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:31.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:32.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:33.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:34.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:35.616 7fad84b46e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:35.616 7fad84b46e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:35.616 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:35.617 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:35.617 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:35.617 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:35.618 7fad84b46e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:35.618 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:35.618 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:35.618 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:35.618 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:35.618 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:22:35.618 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:35.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:36.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:37.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:38.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:39.617 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:39.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:41.747 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:42.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:43.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:44.619 7fad84b46e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:44.619 7fad84b46e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:44.619 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:44.619 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:44.620 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:44.620 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:44.620 7fad84b46e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:44.620 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:44.620 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:44.620 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:44.620 7fad84b46e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:44.620 7fad84b46e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:22:44.620 7fad84b46e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:44.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:45.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:46.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:47.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:48.620 7fad8515fac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:48.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:49.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:50.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:51.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:52.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:53.622 7fad8515fac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:53.622 7fad8515fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:53.623 7fad8515fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:53.623 7fad8515fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:53.623 7fad8515fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:53.623 7fad8515fac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:53.623 7fad8515fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:53.623 7fad8515fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:53.624 7fad8515fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:53.624 7fad8515fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:53.624 7fad8515fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:53.624 7fad8515fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:22:53.624 7fad8515fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:53.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:54.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:55.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:56.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:57.623 7fad8515fac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:57.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:58.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:22:59.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:00.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:01.276 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:23:01.276 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:23:01.276 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:23:01.277 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:23:01.277 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:23:01.277 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:23:01.277 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:23:01.277 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:23:01.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:02.625 7fad8515fac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:02.626 7fad8515fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:02.626 7fad8515fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:02.626 7fad8515fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:02.626 7fad8515fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:02.626 7fad8515fac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:02.626 7fad8515fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:02.627 7fad8515fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:02.627 7fad8515fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:02.627 7fad8515fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:02.627 7fad8515fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:02.627 7fad8515fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:23:02.627 7fad8515fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:02.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:03.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:04.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:05.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:06.627 7fad85566240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:06.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:07.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:08.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:09.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:11.629 7fad85566240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:11.629 7fad85566240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:11.629 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:11.629 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:11.630 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:11.630 7fad85566240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:11.630 7fad85566240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:11.630 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:11.630 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:11.630 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:11.630 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:11.631 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:23:11.631 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:11.749 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:12.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:13.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:14.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:15.630 7fad85566240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:15.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:16.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:17.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:18.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:19.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:20.632 7fad85566240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:20.632 7fad85566240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:20.633 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:20.633 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:20.633 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:20.633 7fad85566240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:20.633 7fad85566240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:20.634 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:20.634 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:20.634 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:20.634 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:20.634 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:23:20.634 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:20.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:21.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:22.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:23.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:24.633 7fad85566240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:24.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:25.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:26.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:27.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:28.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:29.635 7fad85566240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:29.635 7fad85566240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:29.635 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:29.636 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:29.636 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:29.636 7fad85566240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:29.636 7fad85566240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:29.637 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:29.637 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:29.637 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:29.637 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:29.637 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:23:29.637 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:29.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:30.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:31.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:32.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:33.637 7fad85566240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:33.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:34.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:35.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:36.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:37.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:38.639 7fad85566240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:38.639 7fad85566240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:38.639 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:38.640 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:38.640 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:38.640 7fad85566240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:38.640 7fad85566240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:38.640 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:38.640 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:38.640 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:38.640 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:38.641 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:23:38.641 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:38.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:39.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:41.750 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:42.641 7fad85566240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:42.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:43.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:44.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:45.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:46.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:47.642 7fad85566240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:47.643 7fad85566240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:47.643 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:47.643 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:47.643 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:47.643 7fad85566240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:47.643 7fad85566240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:47.643 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:47.644 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:47.644 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:47.644 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:47.644 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:23:47.644 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:47.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:48.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:49.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:50.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:51.643 7fad85566240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:51.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:52.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:53.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:54.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:55.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:56.645 7fad85566240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:56.646 7fad85566240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:56.646 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:56.646 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:56.646 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:56.647 7fad85566240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:56.647 7fad85566240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:56.647 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:56.647 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:56.648 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:56.648 7fad85566240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:56.648 7fad85566240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:23:56.648 7fad85566240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:56.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:57.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:58.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:23:59.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:00.647 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:00.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:01.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:02.266 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:24:02.266 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:24:02.266 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:24:02.266 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:24:02.267 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:24:02.267 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:24:02.267 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:24:02.267 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:24:02.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:03.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:04.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:05.649 7fad84ba5cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:05.649 7fad84ba5cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:05.649 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:05.650 7fad84ba5cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:05.650 7fad84ba5cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:05.650 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:05.650 7fad84ba5cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:05.650 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:05.651 7fad84ba5cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:05.651 7fad84ba5cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:05.651 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:05.651 7fad84ba5cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:24:05.651 7fad84ba5cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:05.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:06.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:07.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:08.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:09.650 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:09.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:11.751 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:12.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:13.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:14.652 7fad84ba5cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:14.653 7fad84ba5cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:14.653 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:14.653 7fad84ba5cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:14.653 7fad84ba5cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:14.653 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:14.654 7fad84ba5cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:14.654 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:14.654 7fad84ba5cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:14.654 7fad84ba5cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:14.654 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:14.654 7fad84ba5cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:24:14.654 7fad84ba5cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:14.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:15.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:16.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:17.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:18.653 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:18.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:19.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:20.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:21.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:22.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:23.655 7fad84ba5cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:23.655 7fad84ba5cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:23.655 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:23.655 7fad84ba5cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:23.655 7fad84ba5cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:23.656 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:23.656 7fad84ba5cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:23.656 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:23.656 7fad84ba5cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:23.656 7fad84ba5cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:23.656 7fad84ba5cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:23.656 7fad84ba5cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:24:23.656 7fad84ba5cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:23.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:24.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:25.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:26.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:27.656 7fad84be5198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:27.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:28.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:29.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:30.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:31.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:32.657 7fad84be5198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:32.658 7fad84be5198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:32.658 7fad84be5198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:32.658 7fad84be5198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:32.658 7fad84be5198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:32.658 7fad84be5198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:32.658 7fad84be5198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:32.658 7fad84be5198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:32.659 7fad84be5198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:32.659 7fad84be5198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:32.659 7fad84be5198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:32.659 7fad84be5198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:24:32.659 7fad84be5198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:32.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:33.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:34.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:35.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:36.659 7fad84be5198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:36.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:37.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:38.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:39.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:41.660 7fad84be5198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:41.660 7fad84be5198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:41.660 7fad84be5198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:41.660 7fad84be5198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:41.660 7fad84be5198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:41.661 7fad84be5198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:41.661 7fad84be5198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:41.661 7fad84be5198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:41.661 7fad84be5198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:41.661 7fad84be5198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:41.661 7fad84be5198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:41.661 7fad84be5198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:24:41.662 7fad84be5198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:41.752 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:42.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:43.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:44.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:45.661 7fad84e54198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:45.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:46.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:47.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:48.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:49.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:50.663 7fad84e54198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:50.663 7fad84e54198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:50.664 7fad84e54198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:50.664 7fad84e54198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:50.664 7fad84e54198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:50.664 7fad84e54198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:50.665 7fad84e54198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:50.665 7fad84e54198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:50.665 7fad84e54198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:50.665 7fad84e54198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:50.665 7fad84e54198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:50.666 7fad84e54198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:24:50.666 7fad84e54198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:50.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:51.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:52.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:53.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:54.664 7fad84e54198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:54.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:55.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:56.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:57.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:58.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:24:59.667 7fad84e54198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:59.668 7fad84e54198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:59.668 7fad84e54198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:59.668 7fad84e54198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:59.668 7fad84e54198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:59.668 7fad84e54198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:59.668 7fad84e54198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:59.669 7fad84e54198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:59.669 7fad84e54198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:59.669 7fad84e54198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:59.669 7fad84e54198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:59.669 7fad84e54198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:24:59.669 7fad84e54198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:59.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:00.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:01.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:02.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:03.253 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:25:03.253 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:25:03.254 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:25:03.254 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:25:03.254 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:25:03.254 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:25:03.254 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:25:03.254 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:25:03.668 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:03.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:04.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:05.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:06.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:07.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:08.671 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:08.671 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:08.671 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:08.671 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:08.671 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:08.671 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:08.672 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:08.672 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:08.672 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:08.672 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:08.672 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:08.673 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:25:08.673 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:08.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:09.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:11.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:12.672 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:12.754 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:13.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:14.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:15.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:16.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:17.675 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:17.675 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:17.675 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:17.675 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:17.675 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:17.675 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:17.676 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:17.676 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:17.676 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:17.676 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:17.676 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:17.676 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:25:17.676 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:17.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:18.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:19.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:20.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:21.675 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:21.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:22.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:23.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:24.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:25.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:26.678 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:26.678 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:26.678 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:26.678 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:26.679 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:26.679 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:26.679 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:26.679 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:26.679 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:26.679 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:26.679 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:26.680 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:25:26.680 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:26.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:27.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:28.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:29.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:30.679 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:30.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:31.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:32.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:33.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:34.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:35.686 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:35.686 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:35.686 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:35.687 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:35.687 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:35.687 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:35.687 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:35.687 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:35.688 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:35.688 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:35.688 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:35.688 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:25:35.689 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:35.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:36.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:37.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:38.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:39.686 7fad8515f630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:39.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:41.753 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:42.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:43.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:44.691 7fad8515f630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:44.691 7fad8515f630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:44.692 7fad8515f630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:44.692 7fad8515f630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:44.692 7fad8515f630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:44.692 7fad8515f630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:44.693 7fad8515f630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:44.693 7fad8515f630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:44.693 7fad8515f630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:44.693 7fad8515f630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:44.693 7fad8515f630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:44.693 7fad8515f630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:25:44.693 7fad8515f630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:44.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:45.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:46.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:47.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:48.692 7fad85074c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:48.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:49.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:50.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:51.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:52.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:53.695 7fad85074c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:53.695 7fad85074c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:53.695 7fad85074c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:53.697 7fad85074c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:53.698 7fad85074c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:53.698 7fad85074c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:53.699 7fad85074c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:53.699 7fad85074c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:53.699 7fad85074c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:53.699 7fad85074c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:53.699 7fad85074c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:53.699 7fad85074c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:25:53.699 7fad85074c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:53.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:54.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:55.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:56.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:57.696 7fad8502db70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:57.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:58.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:25:59.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:00.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:01.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:02.697 7fad8502db70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:02.697 7fad8502db70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:02.697 7fad8502db70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:02.697 7fad8502db70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:02.698 7fad8502db70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:02.698 7fad8502db70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:02.698 7fad8502db70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:02.698 7fad8502db70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:02.698 7fad8502db70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:02.698 7fad8502db70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:02.698 7fad8502db70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:02.698 7fad8502db70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:26:02.699 7fad8502db70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:02.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:03.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:04.224 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:26:04.224 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:26:04.225 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:26:04.225 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:26:04.225 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:26:04.225 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:26:04.225 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:26:04.225 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:26:04.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:05.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:06.697 7fad84b782e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:06.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:07.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:08.739 7fad84fc0438 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:26:08.790 7fad853dac18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:26:08.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:09.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:11.699 7fad84b782e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:11.699 7fad84b782e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:11.700 7fad84b782e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:11.700 7fad84b782e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:11.700 7fad84b782e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:11.700 7fad84b782e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:11.701 7fad84b782e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:11.701 7fad84b782e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:11.701 7fad84b782e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:11.701 7fad84b782e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:11.701 7fad84b782e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:11.701 7fad84b782e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:26:11.701 7fad84b782e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:11.755 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:12.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:13.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:14.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:15.700 7fad84e54048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:15.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:16.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:17.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:18.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:19.028 7fad853daac8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:26:19.086 7fad853daac8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:26:19.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:20.703 7fad84e54048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:20.704 7fad84e54048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:20.704 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:20.704 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:20.704 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:20.704 7fad84e54048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:20.704 7fad84e54048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:20.705 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:20.705 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:20.705 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:20.705 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:20.705 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:26:20.705 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:20.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:21.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:22.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:23.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:24.704 7fad84e54048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:24.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:25.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:26.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:27.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:28.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:29.565 7fad84b8c978 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:26:29.617 7fad84b8c978 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:26:29.706 7fad84e54048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:29.707 7fad84e54048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:29.707 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:29.707 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:29.707 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:29.707 7fad84e54048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:29.708 7fad84e54048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:29.708 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:29.708 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:29.708 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:29.708 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:29.708 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:26:29.708 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:29.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:30.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:31.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:32.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:33.708 7fad84e54048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:33.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:34.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:35.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:36.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:37.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:38.710 7fad84e54048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:38.710 7fad84e54048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:38.710 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:38.710 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:38.710 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:38.710 7fad84e54048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:38.711 7fad84e54048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:38.711 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:38.711 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:38.711 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:38.711 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:38.711 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:26:38.711 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:38.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:39.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:41.756 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:42.710 7fad84e54048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:42.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:43.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:44.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:45.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:46.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:47.712 7fad84e54048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:47.712 7fad84e54048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:47.712 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:47.713 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:47.713 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:47.713 7fad84e54048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:47.713 7fad84e54048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:47.714 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:47.714 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:47.714 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:47.714 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:47.714 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:26:47.714 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:47.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:48.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:49.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:50.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:51.713 7fad84e54048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:51.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:52.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:53.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:54.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:55.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:56.715 7fad84e54048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:56.715 7fad84e54048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:56.715 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:56.715 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:56.715 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:56.715 7fad84e54048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:56.716 7fad84e54048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:56.716 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:56.716 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:56.716 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:56.716 7fad84e54048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:56.716 7fad84e54048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:26:56.716 7fad84e54048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:56.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:57.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:58.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:26:59.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:00.717 7fad85178048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:00.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:01.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:02.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:03.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:04.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:05.240 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:27:05.240 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:27:05.240 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:27:05.241 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:27:05.241 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:27:05.241 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:27:05.241 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:27:05.241 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:27:05.718 7fad85178048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:05.718 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:05.718 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:05.719 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:05.719 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:05.719 7fad85178048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:05.719 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:05.719 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:05.719 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:05.720 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:05.720 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:05.720 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:27:05.720 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:05.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:06.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:07.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:08.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:09.719 7fad85178048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:09.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:11.757 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:12.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:13.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:14.721 7fad85178048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:14.721 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:14.721 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:14.721 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:14.722 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:14.722 7fad85178048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:14.722 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:14.722 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:14.722 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:14.722 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:14.723 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:14.723 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:27:14.723 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:14.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:15.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:16.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:17.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:18.722 7fad85178048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:18.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:19.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:20.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:21.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:22.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:23.724 7fad85178048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:23.724 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:23.724 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:23.724 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:23.724 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:23.724 7fad85178048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:23.725 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:23.725 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:23.725 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:23.725 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:23.725 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:23.725 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:27:23.725 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:23.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:24.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:25.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:26.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:27.724 7fad85178048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:27.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:28.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:29.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:30.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:31.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:32.727 7fad85178048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:32.727 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:32.727 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:32.727 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:32.727 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:32.727 7fad85178048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:32.728 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:32.728 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:32.728 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:32.728 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:32.728 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:32.728 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:27:32.728 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:32.830 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:33.831 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:33.866 7fad85178048 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:27:33.918 7fad85178048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:27:34.834 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:35.835 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:36.728 7fad85178048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:36.836 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:37.837 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:38.839 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:39.840 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:41.730 7fad85178048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:41.731 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:41.731 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:41.731 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:41.731 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:41.731 7fad85178048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:41.732 7fad85178048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:41.732 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:41.732 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:41.732 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:41.732 7fad85178048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:41.732 7fad85178048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:27:41.732 7fad85178048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:41.758 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:42.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:43.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:44.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:45.731 7fad855caac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:45.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:46.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:47.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:48.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:49.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:50.733 7fad855caac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:50.733 7fad855caac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:50.733 7fad855caac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:50.735 7fad855caac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:50.735 7fad855caac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:50.735 7fad855caac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:50.735 7fad855caac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:50.735 7fad855caac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:50.736 7fad855caac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:50.736 7fad855caac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:50.736 7fad855caac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:50.736 7fad855caac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:27:50.736 7fad855caac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:50.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:51.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:52.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:53.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:54.734 7fad855caac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:54.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:55.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:56.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:57.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:58.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:27:59.735 7fad855caac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:59.735 7fad855caac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:59.735 7fad855caac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:59.736 7fad855caac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:59.736 7fad855caac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:59.736 7fad855caac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:59.736 7fad855caac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:59.736 7fad855caac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:59.736 7fad855caac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:59.737 7fad855caac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:59.737 7fad855caac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:59.737 7fad855caac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:27:59.737 7fad855caac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:59.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:00.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:01.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:02.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:03.737 7fad855caac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:03.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:04.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:05.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:06.224 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:28:06.224 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:28:06.225 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:28:06.225 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:28:06.225 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:28:06.225 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:28:06.225 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:28:06.225 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:28:06.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:07.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:08.739 7fad855caac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:08.739 7fad855caac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:08.739 7fad855caac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:08.739 7fad855caac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:08.739 7fad855caac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:08.740 7fad855caac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:08.740 7fad855caac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:08.740 7fad855caac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:08.740 7fad855caac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:08.741 7fad855caac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:08.741 7fad855caac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:08.741 7fad855caac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:28:08.741 7fad855caac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:08.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:09.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:11.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:12.739 7fad84b76198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:12.760 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:13.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:14.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:15.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:16.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:17.742 7fad84b76198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:17.742 7fad84b76198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:17.742 7fad84b76198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:17.742 7fad84b76198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:17.742 7fad84b76198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:17.742 7fad84b76198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:17.743 7fad84b76198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:17.743 7fad84b76198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:17.743 7fad84b76198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:17.743 7fad84b76198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:17.743 7fad84b76198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:17.743 7fad84b76198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:28:17.744 7fad84b76198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:17.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:18.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:19.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:20.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:21.743 7fad84b76198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:21.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:22.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:23.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:24.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:25.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:26.745 7fad84b76198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:26.745 7fad84b76198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:26.745 7fad84b76198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:26.745 7fad84b76198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:26.745 7fad84b76198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:26.745 7fad84b76198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:26.746 7fad84b76198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:26.746 7fad84b76198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:26.746 7fad84b76198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:26.746 7fad84b76198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:26.746 7fad84b76198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:26.746 7fad84b76198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:28:26.746 7fad84b76198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:26.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:27.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:28.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:29.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:30.746 7fad84bcd4e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:30.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:31.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:32.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:33.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:34.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:35.748 7fad84bcd4e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:35.749 7fad84bcd4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:35.749 7fad84bcd4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:35.749 7fad84bcd4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:35.749 7fad84bcd4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:35.750 7fad84bcd4e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:35.750 7fad84bcd4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:35.750 7fad84bcd4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:35.751 7fad84bcd4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:35.751 7fad84bcd4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:35.751 7fad84bcd4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:35.751 7fad84bcd4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:28:35.751 7fad84bcd4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:35.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:36.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:37.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:38.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:39.749 7fad84bcd4e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:39.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:41.759 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:42.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:43.762 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:44.751 7fad84bcd4e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:44.752 7fad84bcd4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:44.752 7fad84bcd4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:44.752 7fad84bcd4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:44.752 7fad84bcd4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:44.752 7fad84bcd4e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:44.753 7fad84bcd4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:44.753 7fad84bcd4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:44.753 7fad84bcd4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:44.753 7fad84bcd4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:44.753 7fad84bcd4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:44.753 7fad84bcd4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:28:44.753 7fad84bcd4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:44.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:45.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:46.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:47.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:48.753 7fad84b9af60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:48.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:49.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:50.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:51.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:52.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:53.755 7fad84b9af60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:53.755 7fad84b9af60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:53.755 7fad84b9af60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:53.756 7fad84b9af60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:53.756 7fad84b9af60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:53.756 7fad84b9af60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:53.756 7fad84b9af60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:53.756 7fad84b9af60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:53.756 7fad84b9af60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:53.756 7fad84b9af60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:53.757 7fad84b9af60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:53.757 7fad84b9af60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:28:53.757 7fad84b9af60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:53.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:54.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:55.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:56.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:57.756 7fad84f60e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:57.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:58.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:28:59.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:00.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:01.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:02.758 7fad84f60e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:02.758 7fad84f60e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:02.758 7fad84f60e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:02.758 7fad84f60e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:02.758 7fad84f60e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:02.758 7fad84f60e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:02.759 7fad84f60e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:02.759 7fad84f60e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:02.759 7fad84f60e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:02.759 7fad84f60e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:02.759 7fad84f60e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:02.759 7fad84f60e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:29:02.759 7fad84f60e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:02.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:03.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:04.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:05.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:06.758 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:06.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:07.158 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:29:07.158 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:29:07.158 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:29:07.158 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:29:07.158 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:29:07.159 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:29:07.159 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:29:07.159 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:29:07.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:08.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:09.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:11.759 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:11.760 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:11.760 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:11.760 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:11.760 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:11.760 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:11.760 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:11.760 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:11.760 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:11.761 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:11.761 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:11.761 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:29:11.761 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:11.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:12.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:13.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:14.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:15.760 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:15.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:16.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:17.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:18.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:19.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:20.762 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:20.762 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:20.763 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:20.763 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:20.763 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:20.763 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:20.763 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:20.763 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:20.763 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:20.764 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:20.764 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:20.764 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:29:20.764 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:20.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:21.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:22.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:23.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:24.764 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:24.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:25.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:26.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:27.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:28.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:29.765 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:29.765 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:29.765 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:29.766 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:29.766 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:29.766 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:29.766 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:29.766 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:29.766 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:29.766 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:29.766 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:29.766 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:29:29.767 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:29.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:30.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:31.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:32.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:33.767 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:33.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:34.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:35.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:36.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:37.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:38.769 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:38.769 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:38.769 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:38.769 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:38.769 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:38.769 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:38.770 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:38.770 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:38.770 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:38.770 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:38.770 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:38.770 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:29:38.770 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:38.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:39.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:41.761 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:42.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:42.769 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:43.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:44.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:45.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:46.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:47.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:47.772 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:47.772 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:47.772 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:47.772 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:47.772 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:47.772 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:47.773 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:47.773 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:47.773 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:47.773 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:47.773 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:47.773 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:29:47.773 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:48.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:49.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:50.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:51.773 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:51.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:52.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:53.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:54.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:55.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:56.775 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:56.775 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:56.776 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:56.776 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:56.776 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:56.776 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:56.776 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:56.777 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:56.777 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:56.777 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:56.777 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:56.777 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:29:56.777 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:56.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:57.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:58.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:29:59.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:00.777 7fad854b3780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:00.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:01.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:02.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:03.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:04.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:05.779 7fad854b3780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:05.780 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:05.780 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:05.780 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:05.780 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:05.780 7fad854b3780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:05.781 7fad854b3780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:05.781 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:05.781 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:05.781 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:05.781 7fad854b3780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:05.781 7fad854b3780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:30:05.781 7fad854b3780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:05.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:06.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:07.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:08.086 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:30:08.087 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:30:08.087 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:30:08.087 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:30:08.087 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:30:08.087 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:30:08.087 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:30:08.087 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:30:08.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:09.781 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:09.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:11.763 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:12.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:13.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:14.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:14.783 7fad84aedf60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:14.783 7fad84aedf60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:14.784 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:14.784 7fad84aedf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:14.784 7fad84aedf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:14.784 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:14.784 7fad84aedf60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:14.785 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:14.785 7fad84aedf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:14.785 7fad84aedf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:14.785 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:14.785 7fad84aedf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:30:14.785 7fad84aedf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:15.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:16.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:17.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:18.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:18.784 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:19.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:20.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:21.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:22.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:23.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:23.787 7fad84aedf60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:23.787 7fad84aedf60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:23.787 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:23.787 7fad84aedf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:23.788 7fad84aedf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:23.788 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:23.789 7fad84aedf60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:23.789 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:23.789 7fad84aedf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:23.789 7fad84aedf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:23.789 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:23.790 7fad84aedf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:30:23.790 7fad84aedf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:24.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:25.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:26.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:27.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:27.788 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:28.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:29.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:30.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:31.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:32.790 7fad84aedf60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:32.791 7fad84aedf60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:32.791 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:32.791 7fad84aedf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:32.791 7fad84aedf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:32.791 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:32.792 7fad84aedf60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:32.792 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:32.792 7fad84aedf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:32.792 7fad84aedf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:32.792 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:32.792 7fad84aedf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:30:32.792 7fad84aedf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:32.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:33.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:34.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:35.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:36.791 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:36.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:37.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:38.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:39.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:41.764 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:41.793 7fad84aedf60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:41.794 7fad84aedf60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:41.794 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:41.794 7fad84aedf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:41.794 7fad84aedf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:41.794 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:41.795 7fad84aedf60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:41.795 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:41.795 7fad84aedf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:41.795 7fad84aedf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:41.795 7fad84aedf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:41.795 7fad84aedf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:30:41.795 7fad84aedf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:42.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:43.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:44.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:45.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:45.794 7fad922610f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:46.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:47.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:48.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:49.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:50.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:50.796 7fad922610f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:50.799 7fad922610f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:50.799 7fad922610f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:50.799 7fad922610f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:50.799 7fad922610f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:50.799 7fad922610f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:50.800 7fad922610f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:50.800 7fad922610f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:50.800 7fad922610f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:50.800 7fad922610f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:50.800 7fad922610f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:50.800 7fad922610f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:30:50.800 7fad922610f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:51.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:52.522 7fad922610f0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:30:52.578 7fad922610f0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:30:52.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:53.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:54.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:54.797 7fad922610f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:55.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:56.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:57.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:58.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:59.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:30:59.799 7fad922610f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:59.799 7fad922610f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:59.800 7fad922610f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:59.800 7fad922610f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:59.800 7fad922610f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:59.800 7fad922610f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:59.800 7fad922610f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:59.801 7fad922610f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:59.801 7fad922610f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:59.801 7fad922610f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:59.801 7fad922610f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:59.801 7fad922610f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:30:59.801 7fad922610f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:00.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:01.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:02.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:02.925 7fad922610f0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:31:02.981 7fad922610f0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:31:03.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:03.800 7fad922610f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:04.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:05.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:06.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:07.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:08.802 7fad922610f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:08.802 7fad922610f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:08.802 7fad922610f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:08.802 7fad922610f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:08.802 7fad922610f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:08.802 7fad922610f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:08.803 7fad922610f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:08.803 7fad922610f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:08.803 7fad922610f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:08.803 7fad922610f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:08.803 7fad922610f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:08.804 7fad922610f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:31:08.804 7fad922610f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:08.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:09.098 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:31:09.098 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:31:09.098 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:31:09.098 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:31:09.098 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:31:09.098 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:31:09.099 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:31:09.099 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:31:09.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:11.765 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:12.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:12.802 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:13.494 7fad84b5a4e0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:31:13.550 7fad84b5a4e0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:31:13.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:14.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:15.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:16.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:17.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:17.804 7fad84b99e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:17.804 7fad84b99e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:17.804 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:17.804 7fad84b99e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:17.804 7fad84b99e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:17.804 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:17.805 7fad84b99e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:17.805 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:17.805 7fad84b99e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:17.805 7fad84b99e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:17.805 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:17.805 7fad84b99e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:31:17.805 7fad84b99e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:18.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:19.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:20.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:21.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:21.805 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:22.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:23.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:24.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:25.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:26.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:26.806 7fad84b99e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:26.807 7fad84b99e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:26.807 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:26.808 7fad84b99e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:26.808 7fad84b99e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:26.808 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:26.808 7fad84b99e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:26.808 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:26.809 7fad84b99e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:26.809 7fad84b99e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:26.809 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:26.809 7fad84b99e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:31:26.809 7fad84b99e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:27.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:28.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:29.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:30.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:30.807 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:31.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:32.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:33.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:34.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:35.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:35.824 7fad84b99e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:35.824 7fad84b99e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:35.824 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:35.825 7fad84b99e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:35.825 7fad84b99e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:35.825 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:35.825 7fad84b99e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:35.825 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:35.826 7fad84b99e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:35.826 7fad84b99e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:35.826 7fad84b99e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:35.826 7fad84b99e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:31:35.826 7fad84b99e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:36.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:37.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:38.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:39.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:39.824 7fad84b38c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:41.766 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:42.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:43.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:44.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:44.825 7fad84b38c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:44.826 7fad84b38c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:44.826 7fad84b38c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:44.826 7fad84b38c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:44.826 7fad84b38c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:44.826 7fad84b38c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:44.827 7fad84b38c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:44.827 7fad84b38c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:44.827 7fad84b38c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:44.827 7fad84b38c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:44.827 7fad84b38c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:44.827 7fad84b38c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:31:44.827 7fad84b38c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:45.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:46.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:47.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:48.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:48.826 7fad84b55978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:49.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:50.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:51.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:52.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:53.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:53.828 7fad84b55978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:53.828 7fad84b55978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:53.828 7fad84b55978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:53.829 7fad84b55978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:53.829 7fad84b55978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:53.829 7fad84b55978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:53.830 7fad84b55978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:53.830 7fad84b55978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:53.830 7fad84b55978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:53.830 7fad84b55978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:53.831 7fad84b55978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:53.831 7fad84b55978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:31:53.831 7fad84b55978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:54.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:55.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:56.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:57.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:57.828 7fad84b99630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:58.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:31:59.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:00.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:01.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:02.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:02.830 7fad84b99630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:02.830 7fad84b99630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:02.830 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:02.831 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:02.831 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:02.831 7fad84b99630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:02.831 7fad84b99630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:02.832 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:02.832 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:02.832 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:02.832 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:02.832 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:32:02.832 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:03.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:04.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:05.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:06.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:06.831 7fad84b99630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:07.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:08.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:09.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:10.048 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:32:10.049 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:32:10.049 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:32:10.049 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:32:10.049 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:32:10.049 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:32:10.049 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:32:10.049 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:32:11.767 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:11.833 7fad84b99630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:11.834 7fad84b99630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:11.834 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:11.834 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:11.834 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:11.834 7fad84b99630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:11.835 7fad84b99630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:11.835 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:11.835 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:11.835 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:11.835 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:11.835 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:32:11.835 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:12.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:13.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:14.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:15.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:15.834 7fad84b99630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:16.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:17.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:18.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:19.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:20.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:20.835 7fad84b99630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:20.836 7fad84b99630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:20.836 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:20.836 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:20.836 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:20.836 7fad84b99630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:20.838 7fad84b99630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:20.838 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:20.838 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:20.838 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:20.838 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:20.838 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:32:20.838 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:21.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:22.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:23.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:24.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:24.836 7fad84b99630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:25.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:26.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:27.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:28.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:29.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:29.838 7fad84b99630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:29.839 7fad84b99630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:29.839 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:29.839 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:29.839 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:29.839 7fad84b99630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:29.839 7fad84b99630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:29.840 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:29.840 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:29.840 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:29.840 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:29.840 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:32:29.840 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:30.466 7fad84b99630 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:32:30.517 7fad84b99630 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:32:30.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:31.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:32.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:33.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:33.839 7fad84b99630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:34.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:35.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:36.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:37.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:38.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:38.842 7fad84b99630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:38.842 7fad84b99630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:38.842 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:38.842 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:38.843 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:38.843 7fad84b99630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:38.843 7fad84b99630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:38.843 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:38.843 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:38.843 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:38.843 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:38.844 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:32:38.844 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:39.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:41.768 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:42.769 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:42.843 7fad84b99630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:43.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:44.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:45.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:46.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:47.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:47.845 7fad84b99630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:47.845 7fad84b99630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:47.845 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:47.846 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:47.846 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:47.846 7fad84b99630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:47.847 7fad84b99630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:47.847 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:47.847 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:47.848 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:47.848 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:47.848 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:32:47.848 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:48.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:49.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:50.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:51.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:51.845 7fad84b99630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:52.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:53.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:54.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:55.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:56.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:56.846 7fad84b99630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:56.847 7fad84b99630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:56.847 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:56.847 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:56.847 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:56.847 7fad84b99630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:56.849 7fad84b99630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:56.849 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:56.849 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:56.849 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:56.849 7fad84b99630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:56.849 7fad84b99630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:32:56.850 7fad84b99630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:57.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:58.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:32:59.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:00.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:00.847 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:01.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:02.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:03.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:04.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:05.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:05.849 7fad84b38eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:05.849 7fad84b38eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:05.849 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:05.850 7fad84b38eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:05.850 7fad84b38eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:05.850 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:05.850 7fad84b38eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:05.851 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:05.851 7fad84b38eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:05.851 7fad84b38eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:05.851 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:05.851 7fad84b38eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:33:05.851 7fad84b38eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:06.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:07.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:08.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:09.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:09.849 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:11.053 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:33:11.054 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:33:11.054 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:33:11.054 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:33:11.054 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:33:11.054 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:33:11.054 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:33:11.054 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:33:11.770 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:12.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:13.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:14.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:14.851 7fad84b38eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:14.852 7fad84b38eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:14.852 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:14.852 7fad84b38eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:14.852 7fad84b38eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:14.852 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:14.852 7fad84b38eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:14.852 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:14.853 7fad84b38eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:14.853 7fad84b38eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:14.853 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:14.853 7fad84b38eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:33:14.853 7fad84b38eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:15.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:16.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:17.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:18.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:18.852 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:19.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:20.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:21.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:22.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:23.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:23.854 7fad84b38eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:23.854 7fad84b38eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:23.854 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:23.855 7fad84b38eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:23.855 7fad84b38eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:23.855 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:23.855 7fad84b38eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:23.855 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:23.855 7fad84b38eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:23.855 7fad84b38eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:23.855 7fad84b38eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:23.855 7fad84b38eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:33:23.856 7fad84b38eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:24.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:25.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:26.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:27.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:27.855 7fad84b5dcc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:28.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:29.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:30.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:31.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:32.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:32.856 7fad84b5dcc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:32.857 7fad84b5dcc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:32.857 7fad84b5dcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:32.857 7fad84b5dcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:32.857 7fad84b5dcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:32.857 7fad84b5dcc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:32.858 7fad84b5dcc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:32.858 7fad84b5dcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:32.858 7fad84b5dcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:32.858 7fad84b5dcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:32.858 7fad84b5dcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:32.858 7fad84b5dcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:33:32.858 7fad84b5dcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:33.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:34.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:35.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:36.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:36.857 7fad84b5dcc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:37.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:38.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:39.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:41.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:41.859 7fad84b5dcc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:41.859 7fad84b5dcc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:41.859 7fad84b5dcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:41.859 7fad84b5dcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:41.859 7fad84b5dcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:41.859 7fad84b5dcc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:41.860 7fad84b5dcc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:41.860 7fad84b5dcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:41.860 7fad84b5dcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:41.860 7fad84b5dcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:41.860 7fad84b5dcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:41.860 7fad84b5dcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:33:41.860 7fad84b5dcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:42.773 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:43.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:44.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:45.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:45.859 7fad8561e978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:46.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:47.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:48.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:49.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:50.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:50.862 7fad8561e978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:50.862 7fad8561e978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:50.862 7fad8561e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:50.862 7fad8561e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:50.862 7fad8561e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:50.863 7fad8561e978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:50.863 7fad8561e978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:50.863 7fad8561e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:50.863 7fad8561e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:50.864 7fad8561e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:50.864 7fad8561e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:50.864 7fad8561e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:33:50.864 7fad8561e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:51.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:52.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:53.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:54.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:54.862 7fad8561e978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:55.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:56.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:57.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:58.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:59.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:33:59.865 7fad8561e978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:59.865 7fad8561e978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:59.865 7fad8561e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:59.865 7fad8561e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:59.865 7fad8561e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:59.865 7fad8561e978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:59.866 7fad8561e978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:59.866 7fad8561e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:59.866 7fad8561e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:59.866 7fad8561e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:59.866 7fad8561e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:59.866 7fad8561e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:33:59.866 7fad8561e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:00.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:01.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:02.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:03.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:03.865 7fad8561e978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:04.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:05.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:06.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:07.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:08.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:08.867 7fad8561e978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:08.867 7fad8561e978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:08.867 7fad8561e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:08.868 7fad8561e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:08.868 7fad8561e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:08.868 7fad8561e978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:08.868 7fad8561e978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:08.868 7fad8561e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:08.868 7fad8561e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:08.869 7fad8561e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:08.869 7fad8561e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:08.869 7fad8561e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:34:08.869 7fad8561e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:09.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:11.771 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:12.068 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:34:12.068 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:34:12.068 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:34:12.068 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:34:12.069 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:34:12.069 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:34:12.069 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:34:12.069 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:34:12.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:12.868 7fad84be5630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:13.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:14.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:15.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:16.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:17.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:17.871 7fad84be5630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:17.871 7fad84be5630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:17.871 7fad84be5630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:17.872 7fad84be5630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:17.872 7fad84be5630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:17.872 7fad84be5630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:17.873 7fad84be5630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:17.873 7fad84be5630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:17.873 7fad84be5630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:17.873 7fad84be5630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:17.873 7fad84be5630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:17.874 7fad84be5630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:34:17.874 7fad84be5630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:18.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:19.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:20.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:21.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:21.870 7fad85192390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:22.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:23.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:24.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:25.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:26.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:26.872 7fad85192390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:26.873 7fad85192390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:26.873 7fad85192390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:26.873 7fad85192390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:26.873 7fad85192390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:26.873 7fad85192390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:26.874 7fad85192390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:26.874 7fad85192390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:26.874 7fad85192390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:26.874 7fad85192390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:26.874 7fad85192390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:26.874 7fad85192390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:34:26.874 7fad85192390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:27.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:28.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:29.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:30.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:30.872 7fad85192390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:31.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:32.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:33.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:34.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:35.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:35.875 7fad85192390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:35.875 7fad85192390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:35.876 7fad85192390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:35.876 7fad85192390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:35.876 7fad85192390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:35.876 7fad85192390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:35.877 7fad85192390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:35.877 7fad85192390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:35.877 7fad85192390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:35.878 7fad85192390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:35.878 7fad85192390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:35.878 7fad85192390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:34:35.878 7fad85192390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:36.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:37.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:38.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:39.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:39.875 7fad85192390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:41.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:42.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:43.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:44.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:44.877 7fad85192390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:44.877 7fad85192390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:44.877 7fad85192390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:44.878 7fad85192390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:44.878 7fad85192390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:44.878 7fad85192390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:44.878 7fad85192390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:44.878 7fad85192390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:44.878 7fad85192390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:44.878 7fad85192390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:44.878 7fad85192390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:44.879 7fad85192390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:34:44.879 7fad85192390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:45.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:46.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:47.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:48.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:48.877 7fad868f2240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:49.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:50.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:51.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:52.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:53.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:53.880 7fad868f2240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:53.880 7fad868f2240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:53.881 7fad868f2240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:53.881 7fad868f2240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:53.881 7fad868f2240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:53.881 7fad868f2240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:53.881 7fad868f2240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:53.882 7fad868f2240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:53.882 7fad868f2240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:53.882 7fad868f2240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:53.882 7fad868f2240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:53.882 7fad868f2240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:34:53.882 7fad868f2240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:54.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:55.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:56.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:57.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:57.881 7fad853ba6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:58.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:34:59.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:00.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:01.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:02.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:02.883 7fad853ba6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:02.883 7fad853ba6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:02.883 7fad853ba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:02.884 7fad853ba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:02.884 7fad853ba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:02.884 7fad853ba6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:02.884 7fad853ba6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:02.884 7fad853ba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:02.885 7fad853ba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:02.885 7fad853ba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:02.885 7fad853ba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:02.885 7fad853ba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:35:02.885 7fad853ba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:03.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:04.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:05.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:06.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:06.884 7fad853ba6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:07.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:08.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:09.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:11.772 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:11.886 7fad853ba6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:11.886 7fad853ba6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:11.886 7fad853ba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:11.887 7fad853ba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:11.887 7fad853ba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:11.887 7fad853ba6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:11.887 7fad853ba6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:11.887 7fad853ba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:11.887 7fad853ba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:11.888 7fad853ba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:11.888 7fad853ba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:11.888 7fad853ba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:35:11.888 7fad853ba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:12.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:13.097 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:35:13.097 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:35:13.097 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:35:13.097 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:35:13.098 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:35:13.098 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:35:13.098 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:35:13.098 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:35:13.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:14.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:15.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:15.887 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:16.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:17.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:18.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:19.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:20.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:20.889 7fad84f2d390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:20.889 7fad84f2d390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:20.889 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:20.889 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:20.890 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:20.890 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:20.890 7fad84f2d390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:20.890 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:20.890 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:20.891 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:20.891 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:20.891 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:35:20.891 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:21.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:22.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:23.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:24.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:24.890 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:25.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:26.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:27.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:28.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:29.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:29.892 7fad84f2d390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:29.893 7fad84f2d390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:29.893 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:29.893 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:29.893 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:29.893 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:29.894 7fad84f2d390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:29.894 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:29.894 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:29.894 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:29.894 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:29.894 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:35:29.894 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:30.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:31.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:32.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:33.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:33.893 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:34.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:35.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:36.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:37.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:38.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:38.895 7fad84f2d390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:38.896 7fad84f2d390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:38.896 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:38.896 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:38.896 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:38.896 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:38.896 7fad84f2d390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:38.897 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:38.897 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:38.897 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:38.897 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:38.897 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:35:38.897 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:39.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:41.774 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:42.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:42.896 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:43.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:44.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:45.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:46.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:47.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:47.899 7fad84f2d390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:47.899 7fad84f2d390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:47.899 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:47.900 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:47.900 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:47.900 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:47.901 7fad84f2d390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:47.901 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:47.901 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:47.901 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:47.901 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:47.901 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:35:47.901 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:48.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:49.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:50.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:51.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:51.899 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:52.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:53.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:54.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:55.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:56.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:56.902 7fad84f2d390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:56.902 7fad84f2d390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:56.902 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:56.902 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:56.902 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:56.902 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:56.903 7fad84f2d390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:56.903 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:56.903 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:56.903 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:56.903 7fad84f2d390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:56.904 7fad84f2d390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:35:56.904 7fad84f2d390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:57.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:58.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:35:59.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:00.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:00.903 7fad84b64438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:01.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:02.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:03.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:04.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:05.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:05.905 7fad84b64438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:05.905 7fad84b64438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:05.905 7fad84b64438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:05.905 7fad84b64438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:05.905 7fad84b64438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:05.905 7fad84b64438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:05.906 7fad84b64438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:05.906 7fad84b64438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:05.906 7fad84b64438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:05.906 7fad84b64438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:05.906 7fad84b64438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:05.906 7fad84b64438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:36:05.906 7fad84b64438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:06.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:07.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:08.801 7fad84b64438 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:36:08.820 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:08.852 7fad84b64438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:36:09.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:09.905 7fad84b64438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:11.775 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:12.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:13.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:14.087 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:36:14.087 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:36:14.087 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:36:14.087 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:36:14.088 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:36:14.088 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:36:14.088 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:36:14.088 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:36:14.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:14.907 7fad84b64438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:14.908 7fad84b64438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:14.908 7fad84b64438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:14.908 7fad84b64438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:14.908 7fad84b64438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:14.908 7fad84b64438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:14.909 7fad84b64438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:14.909 7fad84b64438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:14.909 7fad84b64438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:14.909 7fad84b64438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:14.909 7fad84b64438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:14.909 7fad84b64438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:36:14.910 7fad84b64438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:15.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:16.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:17.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:18.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:18.908 7fad84b64438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:19.230 7fad84be2828 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:36:19.287 7fad84be2828 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:36:19.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:20.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:21.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:22.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:23.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:23.910 7fad84b64438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:23.910 7fad84b64438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:23.911 7fad84b64438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:23.911 7fad84b64438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:23.911 7fad84b64438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:23.911 7fad84b64438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:23.911 7fad84b64438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:23.911 7fad84b64438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:23.911 7fad84b64438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:23.911 7fad84b64438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:23.911 7fad84b64438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:23.912 7fad84b64438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:36:23.912 7fad84b64438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:24.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:25.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:26.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:27.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:27.913 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:28.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:29.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:30.824 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:31.825 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:32.827 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:32.915 7fad84bcd438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:32.915 7fad84bcd438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:32.915 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:32.916 7fad84bcd438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:32.917 7fad84bcd438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:32.917 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:32.917 7fad84bcd438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:32.917 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:32.918 7fad84bcd438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:32.918 7fad84bcd438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:32.918 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:32.918 7fad84bcd438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:36:32.918 7fad84bcd438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:33.829 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:34.750 7fad84bcd438 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:36:34.803 7fad84bcd438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:36:34.830 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:35.831 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:36.833 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:36.916 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:37.835 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:38.836 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:39.838 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:41.776 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:41.918 7fad84bcd438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:41.918 7fad84bcd438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:41.918 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:41.918 7fad84bcd438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:41.918 7fad84bcd438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:41.918 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:41.919 7fad84bcd438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:41.919 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:41.919 7fad84bcd438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:41.919 7fad84bcd438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:41.919 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:41.920 7fad84bcd438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:36:41.920 7fad84bcd438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:42.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:43.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:44.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:45.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:45.918 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:46.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:47.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:48.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:49.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:50.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:50.920 7fad84bcd438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:50.920 7fad84bcd438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:50.920 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:50.920 7fad84bcd438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:50.921 7fad84bcd438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:50.921 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:50.921 7fad84bcd438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:50.921 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:50.922 7fad84bcd438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:50.922 7fad84bcd438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:50.922 7fad84bcd438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:50.922 7fad84bcd438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:36:50.922 7fad84bcd438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:51.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:52.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:53.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:54.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:54.921 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:55.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:56.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:57.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:58.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:59.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:36:59.922 7fad84fd26d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:59.923 7fad84fd26d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:59.923 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:59.923 7fad84fd26d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:59.923 7fad84fd26d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:59.923 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:59.924 7fad84fd26d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:59.924 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:59.924 7fad84fd26d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:59.924 7fad84fd26d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:59.924 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:59.924 7fad84fd26d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:36:59.925 7fad84fd26d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:00.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:01.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:02.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:03.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:03.923 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:04.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:05.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:06.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:07.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:08.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:08.924 7fad84fd26d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:08.925 7fad84fd26d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:08.925 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:08.925 7fad84fd26d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:08.925 7fad84fd26d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:08.925 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:08.926 7fad84fd26d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:08.926 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:08.926 7fad84fd26d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:08.926 7fad84fd26d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:08.926 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:08.926 7fad84fd26d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:37:08.926 7fad84fd26d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:09.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:11.777 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:12.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:12.925 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:13.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:14.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:15.161 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:37:15.161 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:37:15.161 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:37:15.161 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:37:15.162 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:37:15.162 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:37:15.162 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:37:15.162 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:37:15.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:16.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:17.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:17.926 7fad84fd26d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:17.926 7fad84fd26d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:17.927 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:17.927 7fad84fd26d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:17.927 7fad84fd26d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:17.927 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:17.927 7fad84fd26d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:17.928 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:17.928 7fad84fd26d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:17.928 7fad84fd26d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:17.928 7fad84fd26d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:17.928 7fad84fd26d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:37:17.928 7fad84fd26d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:18.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:19.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:20.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:21.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:21.927 7fad85604eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:22.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:23.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:24.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:25.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:26.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:26.929 7fad85604eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:26.930 7fad85604eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:26.930 7fad85604eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:26.930 7fad85604eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:26.930 7fad85604eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:26.930 7fad85604eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:26.930 7fad85604eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:26.930 7fad85604eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:26.931 7fad85604eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:26.931 7fad85604eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:26.931 7fad85604eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:26.931 7fad85604eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:37:26.931 7fad85604eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:27.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:28.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:29.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:30.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:30.930 7fad84b3d240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:31.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:32.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:33.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:34.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:35.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:35.932 7fad84b3d240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:35.932 7fad84b3d240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:35.932 7fad84b3d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:35.933 7fad84b3d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:35.933 7fad84b3d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:35.933 7fad84b3d240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:35.934 7fad84b3d240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:35.934 7fad84b3d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:35.934 7fad84b3d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:35.934 7fad84b3d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:35.934 7fad84b3d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:35.934 7fad84b3d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:37:35.934 7fad84b3d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:36.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:37.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:38.821 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:39.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:39.933 7fad84b3d240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:41.778 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:42.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:43.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:44.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:44.935 7fad84b3d240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:44.935 7fad84b3d240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:44.935 7fad84b3d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:44.935 7fad84b3d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:44.935 7fad84b3d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:44.935 7fad84b3d240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:44.936 7fad84b3d240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:44.936 7fad84b3d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:44.937 7fad84b3d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:44.937 7fad84b3d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:44.937 7fad84b3d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:44.937 7fad84b3d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:37:44.937 7fad84b3d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:45.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:46.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:47.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:48.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:48.935 7fad8502de10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:49.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:50.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:51.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:52.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:53.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:53.937 7fad8502de10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:53.937 7fad8502de10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:53.937 7fad8502de10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:53.937 7fad8502de10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:53.937 7fad8502de10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:53.937 7fad8502de10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:53.938 7fad8502de10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:53.938 7fad8502de10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:53.938 7fad8502de10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:53.938 7fad8502de10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:53.938 7fad8502de10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:53.938 7fad8502de10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:37:53.938 7fad8502de10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:54.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:55.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:56.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:57.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:57.937 7fad8502de10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:58.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:37:59.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:00.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:01.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:02.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:02.939 7fad8502de10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:02.939 7fad8502de10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:02.940 7fad8502de10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:02.940 7fad8502de10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:02.940 7fad8502de10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:02.940 7fad8502de10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:02.940 7fad8502de10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:02.941 7fad8502de10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:02.941 7fad8502de10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:02.941 7fad8502de10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:02.941 7fad8502de10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:02.941 7fad8502de10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:38:02.941 7fad8502de10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:03.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:04.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:05.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:06.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:06.939 7fad8502de10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:07.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:08.820 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:09.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:11.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:11.941 7fad8502de10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:11.942 7fad8502de10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:11.942 7fad8502de10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:11.942 7fad8502de10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:11.942 7fad8502de10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:11.942 7fad8502de10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:11.943 7fad8502de10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:11.943 7fad8502de10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:11.943 7fad8502de10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:11.943 7fad8502de10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:11.943 7fad8502de10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:11.943 7fad8502de10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:38:11.943 7fad8502de10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:12.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:13.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:14.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:15.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:15.942 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:16.314 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:38:16.314 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:38:16.314 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:38:16.314 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:38:16.314 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:38:16.314 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:38:16.314 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:38:16.314 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:38:16.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:17.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:18.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:18.851 7fad84b766d8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:38:18.906 7fad84b37ac8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:38:19.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:20.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:20.944 7fad84b532e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:20.944 7fad84b532e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:20.944 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:20.944 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:20.944 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:20.944 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:20.945 7fad84b532e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:20.945 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:20.945 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:20.945 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:20.945 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:20.945 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:38:20.945 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:21.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:22.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:23.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:24.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:24.944 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:25.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:26.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:27.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:28.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:29.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:29.956 7fad84b532e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:29.957 7fad84b532e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:29.957 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:29.957 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:29.957 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:29.957 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:29.957 7fad84b532e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:29.958 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:29.958 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:29.958 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:29.958 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:29.958 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:38:29.958 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:30.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:31.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:32.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:33.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:33.956 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:34.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:35.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:36.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:37.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:38.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:38.958 7fad84b532e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:38.958 7fad84b532e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:38.958 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:38.959 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:38.959 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:38.959 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:38.959 7fad84b532e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:38.959 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:38.959 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:38.960 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:38.960 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:38.960 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:38:38.960 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:39.821 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:41.779 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:42.781 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:42.959 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:43.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:44.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:45.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:46.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:47.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:47.961 7fad84b532e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:47.962 7fad84b532e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:47.962 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:47.962 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:47.962 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:47.962 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:47.962 7fad84b532e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:47.962 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:47.963 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:47.963 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:47.963 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:47.963 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:38:47.963 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:48.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:49.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:50.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:51.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:51.962 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:52.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:53.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:54.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:55.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:56.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:56.964 7fad84b532e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:56.965 7fad84b532e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:56.965 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:56.965 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:56.965 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:56.965 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:56.966 7fad84b532e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:56.966 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:56.966 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:56.966 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:56.966 7fad84b532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:56.966 7fad84b532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:38:56.966 7fad84b532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:57.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:58.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:38:59.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:00.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:00.966 7fad84bdb978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:01.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:02.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:03.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:04.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:05.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:05.968 7fad84bdb978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:05.968 7fad84bdb978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:05.968 7fad84bdb978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:05.969 7fad84bdb978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:05.969 7fad84bdb978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:05.969 7fad84bdb978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:05.969 7fad84bdb978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:05.969 7fad84bdb978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:05.970 7fad84bdb978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:05.970 7fad84bdb978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:05.970 7fad84bdb978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:05.970 7fad84bdb978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:39:05.970 7fad84bdb978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:06.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:07.820 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:08.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:09.823 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:09.969 7fad84bdb978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:11.780 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:12.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:13.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:14.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:14.971 7fad84bdb978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:14.971 7fad84bdb978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:14.971 7fad84bdb978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:14.971 7fad84bdb978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:14.971 7fad84bdb978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:14.971 7fad84bdb978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:14.972 7fad84bdb978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:14.972 7fad84bdb978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:14.972 7fad84bdb978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:14.972 7fad84bdb978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:14.972 7fad84bdb978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:14.972 7fad84bdb978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:39:14.972 7fad84bdb978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:15.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:16.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:17.310 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:39:17.311 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:39:17.311 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:39:17.311 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:39:17.311 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:39:17.311 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:39:17.311 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:39:17.311 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:39:17.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:18.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:18.975 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:19.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:20.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:21.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:22.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:23.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:23.977 7fad84af7f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:23.977 7fad84af7f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:23.977 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:23.977 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:23.977 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:23.978 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:23.978 7fad84af7f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:23.978 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:23.978 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:23.978 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:23.978 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:23.979 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:39:23.979 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:24.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:25.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:26.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:27.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:27.977 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:28.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:29.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:30.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:31.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:32.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:32.978 7fad84af7f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:32.979 7fad84af7f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:32.979 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:32.979 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:32.979 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:32.979 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:32.979 7fad84af7f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:32.980 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:32.980 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:32.980 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:32.980 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:32.980 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:39:32.980 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:33.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:34.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:35.820 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:36.821 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:36.979 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:37.824 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:38.826 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:39.828 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:41.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:41.981 7fad84af7f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:41.982 7fad84af7f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:41.982 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:41.982 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:41.982 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:41.982 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:41.983 7fad84af7f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:41.983 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:41.984 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:41.984 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:41.984 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:41.984 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:39:41.984 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:42.783 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:43.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:44.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:45.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:45.983 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:46.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:47.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:48.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:49.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:50.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:50.985 7fad84af7f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:50.985 7fad84af7f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:50.985 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:50.985 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:50.985 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:50.985 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:50.986 7fad84af7f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:50.986 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:50.986 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:50.986 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:50.986 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:50.986 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:39:50.986 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:51.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:52.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:53.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:54.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:54.986 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:55.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:56.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:57.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:58.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:59.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:39:59.988 7fad84af7f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:59.988 7fad84af7f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:59.989 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:59.989 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:59.989 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:59.989 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:59.989 7fad84af7f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:59.990 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:59.990 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:59.990 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:59.990 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:59.990 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:39:59.990 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:00.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:01.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:02.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:03.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:03.989 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:04.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:05.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:06.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:07.820 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:08.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:08.991 7fad84af7f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:08.992 7fad84af7f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:08.992 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:08.992 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:08.992 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:08.992 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:08.993 7fad84af7f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:08.993 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:08.993 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:08.993 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:08.993 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:08.993 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:40:08.993 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:09.823 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:11.782 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:12.138 7fad84af7f60 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:40:12.189 7fad84af7f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:40:12.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:12.992 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:13.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:14.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:15.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:16.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:17.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:17.995 7fad84af7f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:17.995 7fad84af7f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:17.995 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:17.995 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:17.996 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:17.996 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:17.996 7fad84af7f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:17.996 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:17.996 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:17.997 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:17.997 7fad84af7f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:17.997 7fad84af7f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:40:17.997 7fad84af7f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:18.373 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:40:18.388 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:40:18.388 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:40:18.388 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:40:18.388 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:40:18.388 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:40:18.388 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:40:18.388 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:40:18.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:19.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:20.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:21.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:21.995 7fad84bcdb70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:22.553 7fad84e5eac8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:40:22.605 7fad84e5eac8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:40:22.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:23.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:24.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:25.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:26.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:26.998 7fad84bcdb70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:26.998 7fad84bcdb70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:26.998 7fad84bcdb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:26.998 7fad84bcdb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:26.998 7fad84bcdb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:26.998 7fad84bcdb70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:26.999 7fad84bcdb70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:26.999 7fad84bcdb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:26.999 7fad84bcdb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:26.999 7fad84bcdb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:26.999 7fad84bcdb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:26.999 7fad84bcdb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:40:26.999 7fad84bcdb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:27.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:28.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:29.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:30.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:30.998 7fad84bcdb70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:31.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:32.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:33.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:34.477 7fad84b2b8d0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:40:34.565 7fad84b2b8d0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:40:34.820 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:35.820 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:36.001 7fad84bcdb70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:36.001 7fad84bcdb70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:36.001 7fad84bcdb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:36.002 7fad84bcdb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:36.002 7fad84bcdb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:36.002 7fad84bcdb70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:36.002 7fad84bcdb70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:36.002 7fad84bcdb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:36.002 7fad84bcdb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:36.003 7fad84bcdb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:36.003 7fad84bcdb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:36.003 7fad84bcdb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:40:36.003 7fad84bcdb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:36.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:37.855 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:38.857 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:39.860 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:40.001 7fad84b2b8d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:41.784 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:42.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:43.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:44.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:45.003 7fad84b2b8d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:45.003 7fad84b2b8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:45.003 7fad84b2b8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:45.003 7fad84b2b8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:45.003 7fad84b2b8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:45.003 7fad84b2b8d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:45.004 7fad84b2b8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:45.004 7fad84b2b8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:45.004 7fad84b2b8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:45.004 7fad84b2b8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:45.004 7fad84b2b8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:45.004 7fad84b2b8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:40:45.004 7fad84b2b8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:45.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:46.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:47.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:48.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:49.003 7fad86204a20 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:49.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:50.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:51.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:52.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:53.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:54.005 7fad86204a20 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:54.006 7fad86204a20 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:54.006 7fad86204a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:54.006 7fad86204a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:54.006 7fad86204a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:54.006 7fad86204a20 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:54.007 7fad86204a20 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:54.007 7fad86204a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:54.007 7fad86204a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:54.007 7fad86204a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:54.007 7fad86204a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:54.007 7fad86204a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:40:54.007 7fad86204a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:54.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:55.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:56.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:57.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:58.006 7fad84b76588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:58.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:40:59.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:00.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:01.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:02.821 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:03.008 7fad84b76588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:03.009 7fad84b76588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:03.009 7fad84b76588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:03.009 7fad84b76588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:03.009 7fad84b76588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:03.009 7fad84b76588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:03.010 7fad84b76588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:03.010 7fad84b76588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:03.010 7fad84b76588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:03.010 7fad84b76588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:03.010 7fad84b76588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:03.010 7fad84b76588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:41:03.010 7fad84b76588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:03.823 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:04.825 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:05.826 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:06.828 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:07.009 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:07.831 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:08.833 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:09.834 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:11.785 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:12.011 7fad84b7ec18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:12.011 7fad84b7ec18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:12.011 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:12.011 7fad84b7ec18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:12.011 7fad84b7ec18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:12.011 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:12.012 7fad84b7ec18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:12.012 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:12.012 7fad84b7ec18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:12.013 7fad84b7ec18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:12.013 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:12.013 7fad84b7ec18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:41:12.013 7fad84b7ec18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:12.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:13.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:14.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:15.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:16.011 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:16.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:17.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:18.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:19.376 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:41:19.376 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:41:19.376 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:41:19.376 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:41:19.377 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:41:19.377 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:41:19.377 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:41:19.377 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:41:19.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:20.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:21.013 7fad84b7ec18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:21.013 7fad84b7ec18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:21.014 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:21.014 7fad84b7ec18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:21.014 7fad84b7ec18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:21.014 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:21.014 7fad84b7ec18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:21.014 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:21.014 7fad84b7ec18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:21.014 7fad84b7ec18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:21.014 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:21.015 7fad84b7ec18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:41:21.015 7fad84b7ec18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:21.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:22.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:23.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:24.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:25.014 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:25.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:26.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:27.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:28.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:29.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:30.016 7fad84b7ec18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:30.016 7fad84b7ec18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:30.016 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:30.017 7fad84b7ec18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:30.017 7fad84b7ec18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:30.017 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:30.018 7fad84b7ec18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:30.018 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:30.018 7fad84b7ec18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:30.018 7fad84b7ec18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:30.018 7fad84b7ec18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:30.018 7fad84b7ec18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:41:30.018 7fad84b7ec18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:30.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:31.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:32.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:33.820 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:34.016 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:34.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:35.823 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:36.825 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:37.827 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:38.828 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:39.018 7fad84f46cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:39.018 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:39.018 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:39.018 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:39.018 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:39.018 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:39.019 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:39.019 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:39.019 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:39.019 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:39.019 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:39.019 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:41:39.019 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:39.829 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:41.786 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:42.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:43.019 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:43.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:44.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:45.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:46.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:47.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:48.022 7fad84f46cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:48.022 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:48.022 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:48.022 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:48.022 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:48.022 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:48.023 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:48.023 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:48.023 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:48.023 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:48.023 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:48.024 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:41:48.024 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:48.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:49.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:50.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:51.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:52.022 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:52.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:53.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:54.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:55.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:56.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:57.024 7fad84f46cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:57.024 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:57.024 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:57.025 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:57.025 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:57.025 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:57.025 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:57.025 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:57.026 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:57.026 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:57.026 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:57.026 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:41:57.026 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:57.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:58.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:41:59.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:00.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:01.025 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:01.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:02.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:03.821 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:04.823 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:05.824 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:06.028 7fad84f46cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:06.028 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:06.028 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:06.028 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:06.028 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:06.028 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:06.029 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:06.029 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:06.029 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:06.029 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:06.029 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:06.029 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:42:06.029 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:06.826 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:07.827 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:08.829 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:09.830 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:10.028 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:11.787 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:12.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:13.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:14.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:15.031 7fad84f46cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:15.031 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:15.031 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:15.031 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:15.031 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:15.032 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:15.032 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:15.032 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:15.032 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:15.032 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:15.032 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:15.032 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:42:15.032 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:15.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:16.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:17.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:18.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:19.033 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:19.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:20.381 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:42:20.382 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:42:20.382 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:42:20.382 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:42:20.382 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:42:20.382 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:42:20.382 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:42:20.383 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:42:20.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:21.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:22.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:23.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:24.035 7fad84f46cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:24.035 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:24.035 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:24.036 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:24.036 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:24.036 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:24.037 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:24.037 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:24.037 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:24.037 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:24.037 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:24.037 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:42:24.037 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:24.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:25.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:26.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:27.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:28.035 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:28.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:29.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:30.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:31.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:32.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:33.038 7fad84f46cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:33.038 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:33.038 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:33.039 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:33.039 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:33.039 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:33.039 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:33.040 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:33.040 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:33.040 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:33.040 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:33.040 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:42:33.040 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:33.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:34.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:35.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:36.821 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:37.038 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:37.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:38.824 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:39.826 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:41.788 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:42.040 7fad84f46cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:42.041 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:42.041 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:42.041 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:42.041 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:42.041 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:42.041 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:42.041 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:42.042 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:42.042 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:42.042 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:42.042 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:42:42.042 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:42.789 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:43.790 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:44.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:45.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:46.041 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:46.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:47.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:48.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:49.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:50.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:51.044 7fad84f46cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:51.045 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:51.045 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:51.045 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:51.045 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:51.046 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:51.046 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:51.046 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:51.047 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:51.047 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:51.047 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:51.047 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:42:51.047 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:51.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:52.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:53.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:54.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:55.045 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:55.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:56.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:57.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:58.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:42:59.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:00.047 7fad84f46cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:00.047 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:00.047 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:00.047 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:00.047 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:00.047 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:00.048 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:00.048 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:00.048 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:00.048 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:00.048 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:00.048 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:43:00.048 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:00.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:01.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:02.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:03.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:04.047 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:04.821 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:05.823 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:06.825 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:07.826 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:08.829 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:09.049 7fad84f46cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:09.050 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:09.050 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:09.050 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:09.050 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:09.050 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:09.051 7fad84f46cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:09.051 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:09.051 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:09.051 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:09.051 7fad84f46cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:09.051 7fad84f46cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:43:09.051 7fad84f46cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:09.830 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:10.855 7fad85564e10 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:43:10.907 7fad85564e10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:43:11.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:12.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:13.050 7fad85190d68 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:13.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:14.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:15.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:16.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:17.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:18.052 7fad85190d68 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:18.052 7fad85190d68 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:18.052 7fad85190d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:18.052 7fad85190d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:18.052 7fad85190d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:18.052 7fad85190d68 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:18.053 7fad85190d68 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:18.053 7fad85190d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:18.053 7fad85190d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:18.054 7fad85190d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:18.054 7fad85190d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:18.054 7fad85190d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:43:18.054 7fad85190d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:18.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:19.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:20.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:21.385 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:43:21.385 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:43:21.385 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:43:21.385 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:43:21.385 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:43:21.386 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:43:21.386 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:43:21.386 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:43:21.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:22.053 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:22.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:23.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:24.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:25.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:26.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:27.055 7fad8528dc18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:27.055 7fad8528dc18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:27.056 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:27.056 7fad8528dc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:27.056 7fad8528dc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:27.056 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:27.056 7fad8528dc18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:27.056 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:27.057 7fad8528dc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:27.057 7fad8528dc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:27.057 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:27.057 7fad8528dc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:43:27.057 7fad8528dc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:27.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:28.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:29.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:30.820 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:31.056 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:31.821 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:32.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:33.823 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:34.825 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:35.826 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:36.058 7fad8528dc18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:36.058 7fad8528dc18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:36.059 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:36.059 7fad8528dc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:36.059 7fad8528dc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:36.059 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:36.059 7fad8528dc18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:36.060 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:36.060 7fad8528dc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:36.060 7fad8528dc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:36.060 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:36.060 7fad8528dc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:43:36.060 7fad8528dc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:36.828 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:37.830 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:38.832 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:39.833 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:40.058 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:41.791 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:42.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:43.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:44.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:45.060 7fad8528dc18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:45.061 7fad8528dc18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:45.061 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:45.061 7fad8528dc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:45.061 7fad8528dc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:45.061 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:45.061 7fad8528dc18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:45.061 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:45.062 7fad8528dc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:45.062 7fad8528dc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:45.062 7fad8528dc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:45.062 7fad8528dc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:43:45.062 7fad8528dc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:45.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:46.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:47.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:48.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:49.061 7fad854cde10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:49.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:50.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:51.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:52.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:53.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:54.064 7fad854cde10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:54.064 7fad854cde10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:54.064 7fad854cde10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:54.064 7fad854cde10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:54.064 7fad854cde10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:54.064 7fad854cde10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:54.065 7fad854cde10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:54.065 7fad854cde10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:54.065 7fad854cde10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:54.065 7fad854cde10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:54.065 7fad854cde10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:54.065 7fad854cde10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:43:54.065 7fad854cde10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:54.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:55.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:56.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:57.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:58.065 7fad854cde10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:58.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:43:59.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:00.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:01.821 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:02.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:03.067 7fad854cde10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:03.067 7fad854cde10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:03.068 7fad854cde10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:03.068 7fad854cde10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:03.068 7fad854cde10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:03.068 7fad854cde10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:03.069 7fad854cde10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:03.069 7fad854cde10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:03.069 7fad854cde10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:03.069 7fad854cde10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:03.069 7fad854cde10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:03.069 7fad854cde10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:44:03.069 7fad854cde10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:03.825 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:04.827 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:05.827 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:06.828 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:07.068 7fad854cde10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:07.830 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:08.832 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:09.834 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:11.792 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:12.070 7fad854cde10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:12.070 7fad854cde10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:12.070 7fad854cde10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:12.071 7fad854cde10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:12.072 7fad854cde10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:12.072 7fad854cde10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:12.072 7fad854cde10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:12.072 7fad854cde10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:12.072 7fad854cde10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:12.072 7fad854cde10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:12.072 7fad854cde10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:12.073 7fad854cde10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:44:12.073 7fad854cde10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:12.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:13.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:14.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:15.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:16.070 7fad854cde10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:16.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:17.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:18.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:19.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:20.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:21.072 7fad854cde10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:21.072 7fad854cde10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:21.072 7fad854cde10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:21.073 7fad854cde10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:21.073 7fad854cde10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:21.073 7fad854cde10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:21.073 7fad854cde10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:21.074 7fad854cde10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:21.074 7fad854cde10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:21.074 7fad854cde10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:21.074 7fad854cde10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:21.074 7fad854cde10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:44:21.074 7fad854cde10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:21.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:22.372 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:44:22.372 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:44:22.372 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:44:22.372 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:44:22.372 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:44:22.372 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:44:22.373 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:44:22.373 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:44:22.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:23.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:24.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:25.072 7fad84b46978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:25.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:26.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:27.820 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:28.821 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:29.823 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:30.075 7fad84b46978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:30.075 7fad84b46978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:30.076 7fad84b46978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:30.076 7fad84b46978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:30.076 7fad84b46978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:30.076 7fad84b46978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:30.077 7fad84b46978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:30.077 7fad84b46978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:30.077 7fad84b46978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:30.077 7fad84b46978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:30.077 7fad84b46978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:30.077 7fad84b46978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:44:30.077 7fad84b46978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:30.826 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:31.827 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:32.828 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:33.830 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:34.076 7fad84b46978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:34.831 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:35.832 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:36.833 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:37.834 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:38.836 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:39.078 7fad84b46978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:39.078 7fad84b46978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:39.078 7fad84b46978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:39.079 7fad84b46978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:39.079 7fad84b46978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:39.079 7fad84b46978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:39.079 7fad84b46978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:39.079 7fad84b46978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:39.080 7fad84b46978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:39.080 7fad84b46978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:39.080 7fad84b46978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:39.080 7fad84b46978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:44:39.080 7fad84b46978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:39.838 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:41.793 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:42.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:43.079 7fad84b46978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:43.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:44.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:45.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:46.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:47.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:48.081 7fad84b46978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:48.081 7fad84b46978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:48.081 7fad84b46978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:48.081 7fad84b46978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:48.081 7fad84b46978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:48.081 7fad84b46978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:48.082 7fad84b46978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:48.082 7fad84b46978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:48.082 7fad84b46978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:48.082 7fad84b46978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:48.082 7fad84b46978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:48.082 7fad84b46978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:44:48.082 7fad84b46978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:48.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:49.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:50.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:51.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:52.082 7fad84b46978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:52.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:53.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:54.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:55.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:56.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:57.084 7fad84b46978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:57.084 7fad84b46978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:57.084 7fad84b46978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:57.085 7fad84b46978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:57.085 7fad84b46978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:57.085 7fad84b46978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:57.085 7fad84b46978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:57.085 7fad84b46978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:57.085 7fad84b46978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:57.086 7fad84b46978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:57.086 7fad84b46978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:57.086 7fad84b46978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:44:57.086 7fad84b46978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:57.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:58.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:44:59.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:00.821 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:01.085 7fad84fd2198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:01.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:02.823 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:03.825 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:04.827 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:05.828 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:06.087 7fad84fd2198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:06.087 7fad84fd2198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:06.087 7fad84fd2198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:06.088 7fad84fd2198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:06.088 7fad84fd2198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:06.088 7fad84fd2198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:06.088 7fad84fd2198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:06.089 7fad84fd2198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:06.089 7fad84fd2198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:06.089 7fad84fd2198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:06.089 7fad84fd2198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:06.089 7fad84fd2198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:45:06.089 7fad84fd2198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:06.830 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:07.832 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:08.833 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:09.835 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:10.087 7fad84fd2198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:11.794 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:12.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:13.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:14.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:15.089 7fad84fd2198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:15.089 7fad84fd2198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:15.089 7fad84fd2198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:15.089 7fad84fd2198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:15.089 7fad84fd2198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:15.089 7fad84fd2198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:15.090 7fad84fd2198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:15.090 7fad84fd2198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:15.090 7fad84fd2198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:15.090 7fad84fd2198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:15.090 7fad84fd2198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:15.090 7fad84fd2198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:45:15.090 7fad84fd2198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:15.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:16.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:17.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:18.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:19.089 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:19.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:20.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:21.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:22.830 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:23.840 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:23.877 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:45:23.877 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:45:23.877 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:45:23.878 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:45:23.878 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:45:23.878 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:45:23.878 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:45:23.878 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:45:24.092 7fad84ba3390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:24.092 7fad84ba3390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:24.092 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:24.092 7fad84ba3390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:24.093 7fad84ba3390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:24.093 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:24.093 7fad84ba3390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:24.094 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:24.094 7fad84ba3390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:24.095 7fad84ba3390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:24.095 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:24.095 7fad84ba3390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:45:24.095 7fad84ba3390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:24.842 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:25.845 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:26.846 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:27.847 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:28.092 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:28.849 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:29.851 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:30.853 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:31.855 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:32.857 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:33.095 7fad84ba3390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:33.095 7fad84ba3390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:33.095 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:33.095 7fad84ba3390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:33.096 7fad84ba3390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:33.096 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:33.096 7fad84ba3390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:33.097 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:33.097 7fad84ba3390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:33.097 7fad84ba3390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:33.097 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:33.097 7fad84ba3390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:45:33.097 7fad84ba3390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:33.862 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:34.864 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:35.865 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:36.867 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:37.095 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:37.868 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:38.870 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:39.871 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:41.795 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:42.097 7fad84ba3390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:42.097 7fad84ba3390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:42.097 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:42.098 7fad84ba3390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:42.098 7fad84ba3390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:42.098 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:42.099 7fad84ba3390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:42.099 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:42.099 7fad84ba3390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:42.099 7fad84ba3390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:42.099 7fad84ba3390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:42.099 7fad84ba3390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:45:42.099 7fad84ba3390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:42.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:43.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:44.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:45.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:46.097 7fad84b38a20 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:46.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:47.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:48.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:49.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:49.961 7fad84bd8630 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:45:50.012 7fad84bd8630 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:45:50.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:51.099 7fad84b38a20 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:51.099 7fad84b38a20 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:51.099 7fad84b38a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:51.100 7fad84b38a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:51.100 7fad84b38a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:51.100 7fad84b38a20 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:51.100 7fad84b38a20 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:51.100 7fad84b38a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:51.100 7fad84b38a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:51.100 7fad84b38a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:51.100 7fad84b38a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:51.101 7fad84b38a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:45:51.101 7fad84b38a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:51.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:52.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:53.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:54.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:55.100 7fad84bd8630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:55.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:56.820 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:57.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:58.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:45:59.824 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:00.043 7fad8528d4e0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:46:00.093 7fad8528d4e0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:46:00.101 7fad84bd8630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:00.101 7fad84bd8630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:00.101 7fad84bd8630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:00.101 7fad84bd8630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:00.102 7fad84bd8630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:00.102 7fad84bd8630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:00.102 7fad84bd8630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:00.103 7fad84bd8630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:00.103 7fad84bd8630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:00.103 7fad84bd8630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:00.103 7fad84bd8630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:00.103 7fad84bd8630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:46:00.103 7fad84bd8630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:00.826 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:01.828 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:02.829 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:03.830 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:04.101 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:04.833 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:05.834 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:06.836 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:07.838 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:08.848 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:09.104 7fad8528d4e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:09.104 7fad8528d4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:09.104 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:09.104 7fad8528d4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:09.104 7fad8528d4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:09.104 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:09.105 7fad8528d4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:09.105 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:09.105 7fad8528d4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:09.105 7fad8528d4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:09.105 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:09.105 7fad8528d4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:46:09.105 7fad8528d4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:09.849 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:10.965 7fad8528d4e0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:46:11.020 7fad8528d4e0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:46:11.796 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:12.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:13.105 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:13.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:14.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:15.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:16.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:17.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:18.107 7fad8528d4e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:18.108 7fad8528d4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:18.108 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:18.108 7fad8528d4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:18.108 7fad8528d4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:18.108 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:18.108 7fad8528d4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:18.109 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:18.109 7fad8528d4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:18.109 7fad8528d4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:18.109 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:18.109 7fad8528d4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:46:18.109 7fad8528d4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:18.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:19.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:20.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:21.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:22.108 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:22.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:23.815 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:24.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:24.892 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:46:24.892 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:46:24.892 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:46:24.892 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:46:24.892 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:46:24.893 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:46:24.893 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:46:24.893 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:46:25.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:26.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:27.110 7fad8528d4e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:27.111 7fad8528d4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:27.111 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:27.111 7fad8528d4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:27.111 7fad8528d4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:27.111 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:27.112 7fad8528d4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:27.112 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:27.112 7fad8528d4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:27.112 7fad8528d4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:27.112 7fad8528d4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:27.112 7fad8528d4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:46:27.113 7fad8528d4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:27.821 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:28.823 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:29.825 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:30.826 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:31.111 7fad85141978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:31.829 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:32.830 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:33.832 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:34.834 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:35.835 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:36.113 7fad85141978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:36.114 7fad85141978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:36.114 7fad85141978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:36.114 7fad85141978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:36.114 7fad85141978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:36.114 7fad85141978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:36.114 7fad85141978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:36.114 7fad85141978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:36.115 7fad85141978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:36.115 7fad85141978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:36.115 7fad85141978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:36.115 7fad85141978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:46:36.115 7fad85141978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:36.837 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:37.839 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:38.840 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:39.841 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:40.114 7fad85141978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:41.797 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:42.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:43.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:44.802 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:45.117 7fad85141978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:45.117 7fad85141978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:45.117 7fad85141978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:45.117 7fad85141978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:45.117 7fad85141978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:45.117 7fad85141978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:45.118 7fad85141978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:45.118 7fad85141978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:45.118 7fad85141978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:45.118 7fad85141978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:45.118 7fad85141978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:45.119 7fad85141978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:46:45.119 7fad85141978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:45.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:46.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:47.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:48.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:49.117 7fad85034630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:49.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:50.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:51.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:52.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:53.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:54.119 7fad85034630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:54.119 7fad85034630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:54.119 7fad85034630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:54.120 7fad85034630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:54.120 7fad85034630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:54.120 7fad85034630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:54.120 7fad85034630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:54.121 7fad85034630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:54.121 7fad85034630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:54.121 7fad85034630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:54.121 7fad85034630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:54.121 7fad85034630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:46:54.121 7fad85034630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:54.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:55.821 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:56.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:57.824 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:58.120 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:58.826 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:46:59.827 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:00.829 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:01.831 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:02.832 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:03.123 7fad84b46c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:03.124 7fad84b46c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:03.124 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:03.124 7fad84b46c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:03.124 7fad84b46c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:03.124 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:03.125 7fad84b46c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:03.125 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:03.125 7fad84b46c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:03.125 7fad84b46c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:03.125 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:03.125 7fad84b46c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:47:03.125 7fad84b46c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:03.834 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:04.835 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:05.836 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:06.838 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:07.124 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:07.840 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:08.842 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:09.844 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:11.798 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:12.126 7fad84b46c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:12.127 7fad84b46c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:12.127 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:12.127 7fad84b46c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:12.127 7fad84b46c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:12.127 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:12.127 7fad84b46c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:12.128 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:12.128 7fad84b46c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:12.128 7fad84b46c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:12.128 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:12.128 7fad84b46c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:47:12.128 7fad84b46c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:12.800 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:13.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:14.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:15.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:16.127 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:16.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:17.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:18.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:19.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:20.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:21.130 7fad84b46c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:21.130 7fad84b46c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:21.130 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:21.130 7fad84b46c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:21.130 7fad84b46c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:21.130 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:21.131 7fad84b46c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:21.131 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:21.131 7fad84b46c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:21.132 7fad84b46c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:21.132 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:21.132 7fad84b46c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:47:21.132 7fad84b46c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:21.422 7fad84b46c18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:47:21.472 7fad84b46c18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:47:21.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:22.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:23.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:24.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:25.130 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:25.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:26.008 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:47:26.008 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:47:26.008 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:47:26.009 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:47:26.009 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:47:26.009 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:47:26.009 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:47:26.009 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:47:26.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:27.820 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:28.823 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:29.824 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:30.132 7fad84b46c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:30.132 7fad84b46c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:30.132 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:30.133 7fad84b46c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:30.133 7fad84b46c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:30.133 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:30.133 7fad84b46c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:30.133 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:30.134 7fad84b46c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:30.134 7fad84b46c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:30.134 7fad84b46c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:30.134 7fad84b46c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:47:30.134 7fad84b46c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:30.825 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:31.827 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:32.828 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:33.830 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:34.133 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:34.831 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:35.832 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:36.834 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:37.835 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:38.837 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:39.135 7fad84af9f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:39.136 7fad84af9f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:39.136 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:39.136 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:39.136 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:39.136 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:39.137 7fad84af9f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:39.137 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:39.137 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:39.137 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:39.137 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:39.137 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:47:39.138 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:39.839 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:41.799 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:42.801 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:43.137 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:43.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:44.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:45.806 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:46.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:47.808 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:48.138 7fad84af9f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:48.138 7fad84af9f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:48.139 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:48.139 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:48.139 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:48.139 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:48.139 7fad84af9f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:48.139 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:48.139 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:48.140 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:48.140 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:48.140 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:47:48.140 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:48.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:49.811 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:50.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:51.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:52.139 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:52.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:53.817 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:54.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:55.820 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:56.822 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:57.141 7fad84af9f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:57.141 7fad84af9f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:57.141 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:57.142 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:57.142 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:57.142 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:57.142 7fad84af9f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:57.142 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:57.142 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:57.142 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:57.143 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:57.143 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:47:57.143 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:57.824 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:58.825 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:47:59.826 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:00.827 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:01.142 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:48:01.829 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:02.830 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:03.832 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:04.833 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:05.835 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:06.145 7fad84af9f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:48:06.145 7fad84af9f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:48:06.145 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:06.146 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:48:06.146 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:06.146 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:48:06.146 7fad84af9f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:48:06.147 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:06.147 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:48:06.147 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:06.147 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:06.147 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:48:06.147 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:06.837 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:07.838 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:08.840 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:09.841 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:10.146 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:48:11.803 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:12.804 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:13.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:14.805 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:15.149 7fad84af9f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:48:15.149 7fad84af9f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:48:15.149 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:15.150 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:48:15.150 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:15.150 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:48:15.151 7fad84af9f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:48:15.151 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:15.151 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:48:15.151 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:15.151 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:15.151 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:48:15.152 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:15.807 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:16.809 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:17.810 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:18.812 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:19.149 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:48:19.813 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:20.814 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:21.816 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:22.818 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:23.259 7fad84bb0198 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 06/02/2025 02:48:23.311 7fad84bb0198 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/02/2025 02:48:23.819 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:24.152 7fad84af9f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:48:24.152 7fad84af9f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:48:24.153 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:24.153 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:48:24.153 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:24.153 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:48:24.153 7fad84af9f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:48:24.153 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:24.154 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.129:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.129:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.129:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.129.134.190:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:48:24.154 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:24.154 7fad84af9f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:24.154 7fad84af9f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1748830046237261 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 24 >> 06/02/2025 02:48:24.154 7fad84af9f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:24.821 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:25.823 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:26.824 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:27.069 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 06/02/2025 02:48:27.069 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 06/02/2025 02:48:27.069 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 06/02/2025 02:48:27.069 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 06/02/2025 02:48:27.069 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 06/02/2025 02:48:27.069 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 06/02/2025 02:48:27.069 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 06/02/2025 02:48:27.069 7fad868f2f60 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 06/02/2025 02:48:27.827 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:28.153 7fad8552d588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:48:28.829 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 06/02/2025 02:48:29.830 7fad8571b4e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process.